-- Logs begin at Thu 2022-08-18 10:18:03 UTC, end at Thu 2022-08-18 11:24:51 UTC. -- Aug 18 10:54:15.532085 dv-cinder-826608-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 10:54:15.540493 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 10:54:15.542811 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 10:54:15 2022] *** Aug 18 10:54:15.542811 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 10:54:15.542811 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 10:54:15.542811 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: nodename: dv-cinder-826608-10-iscsi Aug 18 10:54:15.542811 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: machine: x86_64 Aug 18 10:54:15.542811 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: clock source: unix Aug 18 10:54:15.542811 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: pcre jit disabled Aug 18 10:54:15.542811 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: detected number of CPU cores: 4 Aug 18 10:54:15.542811 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: current working directory: / Aug 18 10:54:15.542811 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: detected binary path: /usr/bin/uwsgi-core Aug 18 10:54:15.543415 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: your processes number limit is 47680 Aug 18 10:54:15.543415 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: your memory page size is 4096 bytes Aug 18 10:54:15.543415 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: detected max file descriptor number: 2048 Aug 18 10:54:15.543415 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: lock engine: pthread robust mutexes Aug 18 10:54:15.543415 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: thunder lock: enabled Aug 18 10:54:15.543415 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 10:54:15.543415 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 10:54:15.582652 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: Python main interpreter initialized at 0x55651b24d9c0 Aug 18 10:54:15.582652 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: python threads support enabled Aug 18 10:54:15.582652 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: your server socket listen backlog is limited to 100 connections Aug 18 10:54:15.582652 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: your mercy for graceful operations on workers is 90 seconds Aug 18 10:54:15.583065 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 10:54:15.583065 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: *** Operational MODE: preforking *** Aug 18 10:54:15.583327 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: *** uWSGI is running in multiple interpreter mode *** Aug 18 10:54:15.583327 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: spawned uWSGI master process (pid: 105477) Aug 18 10:54:15.583556 dv-cinder-826608-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 10:54:15.586505 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: spawned uWSGI worker 1 (pid: 105478, cores: 1) Aug 18 10:54:15.586505 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: spawned uWSGI worker 2 (pid: 105479, cores: 1) Aug 18 10:54:15.586505 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 10:54:16.246768 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 10:54:16.247368 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 10:54:17.336995 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 10:54:17.336995 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: from cryptography.utils import int_from_bytes Aug 18 10:54:17.337618 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 10:54:17.337618 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: from cryptography.utils import int_from_bytes Aug 18 10:54:17.341546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 10:54:17.341546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: from cryptography.utils import int_from_bytes Aug 18 10:54:17.341971 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 10:54:17.341971 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: from cryptography.utils import int_from_bytes Aug 18 10:54:19.836248 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 10:54:19.836809 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 10:54:19.837009 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 10:54:19.837361 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 10:54:19.837635 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 10:54:19.838001 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 10:54:19.838391 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.838486 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 10:54:19.838555 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.838627 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.838778 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 10:54:19.838928 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.839147 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 10:54:19.839283 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.839398 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 10:54:19.839541 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.839780 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.839869 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.840105 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.840192 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.840430 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.840516 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.840708 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.840793 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.841018 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.841111 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.841335 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-10-iscsi {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.841420 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.841676 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.841778 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.841981 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.842079 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.842286 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.842374 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.842556 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.842643 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.842872 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.842959 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.843185 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.843278 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-10-iscsi {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.843484 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.843578 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.843794 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.843976 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.844119 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.845129 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.845227 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.845227 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.845358 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.845358 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.845481 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.845481 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.845642 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.845642 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.845918 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.846041 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.846121 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.846245 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.846432 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.846561 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.846728 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.846920 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.847093 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.847222 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.847386 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.847624 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-10-iscsi {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.847753 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.847951 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.848079 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.848259 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.848404 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.848579 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.848720 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.848890 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.849023 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.849280 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.849420 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-10-iscsi {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.849608 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.849737 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.849921 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.850057 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.850238 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.850377 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.850538 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.850911 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.851033 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.851164 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.851295 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.851420 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.851543 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.851666 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.851787 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.851916 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.852041 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.852171 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.852332 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.852468 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.852635 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.852763 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.852950 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.853092 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.853251 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.853381 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.853572 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.853705 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.853829 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.853963 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.854115 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.854256 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.854432 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.854577 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.854747 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.854883 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.855065 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.855279 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.855407 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.855539 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.855664 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.855788 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.855919 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.856044 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.856178 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.856303 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.856437 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.856595 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.856733 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.856858 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.857018 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.857146 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.857321 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.857458 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.857645 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.857787 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.857950 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.858085 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.858250 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.858391 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.858559 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.858686 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.858872 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.859000 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.859181 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.859317 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.859486 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.859615 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.859787 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.859920 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.860090 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.860233 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.860414 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.860541 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.860713 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.860839 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.861017 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.861146 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.861327 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.861465 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.861670 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.861805 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.861975 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.862103 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.862289 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.862944 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.863154 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.863282 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.863550 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.863685 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.863856 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.863982 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.864161 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.864289 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.864477 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.864613 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.864796 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.864923 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.865098 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.865239 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.865367 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.865490 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.865644 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.865768 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.865940 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.866078 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.866254 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.866383 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.866555 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.866683 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.866855 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.866993 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.867155 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.867282 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.867450 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.867577 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.867749 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.867884 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.868047 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.868175 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.868348 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.868475 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.868646 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.868788 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.868944 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.869071 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.869240 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.869365 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.869577 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.869710 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.869858 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.869985 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.870156 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.870294 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.870457 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.870585 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.870769 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.870891 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.871067 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.871194 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.871359 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.871492 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.871652 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.871789 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.871951 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.872087 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.872262 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.872398 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.872562 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.872690 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.872861 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.872990 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.873164 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.873292 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.873461 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.873612 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.873785 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.873913 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.874097 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.874299 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.874424 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.874546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.874688 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.874814 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.875000 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.875136 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.875295 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.875422 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.875594 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.875721 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.875899 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.876025 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.876195 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.876320 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.876493 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.876628 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.876789 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.876916 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.877087 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.877214 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.877384 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.877569 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.877696 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.877818 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.877999 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.878723 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.878850 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.878987 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.879149 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.879278 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.879453 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.879583 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.879757 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.879894 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.880058 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.880194 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.880360 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.880488 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.880663 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.880792 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.880967 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.881102 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.881286 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.881422 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.881630 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.881768 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.881939 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.882068 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.882243 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.882377 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.882578 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 10:54:19.882707 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.882878 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.883013 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.883190 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.883326 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.883500 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.883629 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.883810 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.883938 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.884132 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.884269 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.884439 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.884573 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.884746 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.884874 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.885052 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.885191 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.885365 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.885500 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.885702 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.885846 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.886011 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.886145 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.886323 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.886458 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.886624 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.886862 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.886992 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.887129 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.887262 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.887387 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.887511 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.887643 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.887827 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.887965 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.888144 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.888271 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.888450 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.888577 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.888757 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.888920 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.889073 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.889202 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.889401 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.889551 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.889743 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.889871 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.890050 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.890176 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.890355 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.890482 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.890660 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.890789 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.890967 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.891096 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.891286 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.891414 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.891608 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.891737 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.891914 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.892049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.892228 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.892349 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.892629 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.892780 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.892891 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.892996 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.893134 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.893377 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.893491 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.893648 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.894418 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.894602 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.894739 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.894874 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.895000 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.895126 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.895320 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.895535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.895731 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.895934 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.896129 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.896322 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.896520 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.896715 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.896917 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.897111 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.897245 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.897431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.897625 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.897818 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.897818 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.898206 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.898402 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.898604 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.898796 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.898996 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.899201 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.899406 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.899600 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.899792 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.899977 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.900172 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.900390 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.900589 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.900589 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.900905 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.901031 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.901154 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.901154 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.901446 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.901641 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.901787 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.901925 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.902060 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.902186 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.902317 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.902450 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.902623 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.902758 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.902897 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.903031 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.903171 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.903297 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.903421 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.903544 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.903682 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.903808 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.903932 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.904063 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.904188 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.904311 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.904443 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.904568 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.904691 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.904815 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.904938 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.905069 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.905195 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.905317 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.905440 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.905589 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.905718 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.905923 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.906050 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.906174 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.906287 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.906408 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.906532 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.906664 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.906790 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.906913 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.907036 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.907160 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.907282 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.907414 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.907783 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.907922 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.908048 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.908171 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.908304 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.908429 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.908552 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.908683 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.908808 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.908940 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.909077 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.909203 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.910100 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.910306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.910458 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.910584 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.910718 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.911001 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.911141 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.911268 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.911402 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.911528 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.911665 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.911791 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.911922 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.912049 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.912173 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.912311 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.912438 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.912565 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.912691 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.912815 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.912939 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.913071 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.913196 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.913320 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.913451 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.913603 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.913731 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.913867 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.913992 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.914117 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.914241 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.914364 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.914488 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.914620 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.914753 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.914877 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.915001 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.915198 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.915339 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.915508 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.915637 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.915820 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.915949 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.916130 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.916269 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.916440 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.916568 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.916748 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.916876 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.917056 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.917197 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.917374 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.917502 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.917705 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.917833 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.918022 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.918160 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.918358 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.918500 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.918687 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.918815 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.918993 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.919135 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.919333 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.919469 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.919635 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.919763 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.919945 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.920072 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.920270 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.920400 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.920585 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.920713 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.920895 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.921022 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.921199 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.921333 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.921508 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.921649 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.921841 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.921957 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.922147 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.922275 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.922453 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.922581 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.922760 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.922889 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.923067 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.923194 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.923377 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.923515 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.923681 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.923810 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.923988 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.924114 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.924291 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.924426 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.924597 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.924723 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.924921 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.925101 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.925317 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.925457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.925604 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.925730 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.925854 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.925978 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.926150 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.926291 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.926456 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.926582 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.926768 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.926902 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.927068 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.927208 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.927379 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.927507 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.927684 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.927811 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.927989 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.928119 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.928296 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.928424 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.928600 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.928728 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.928903 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.929031 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.929209 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.929336 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.929534 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.929675 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.929843 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.929972 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.930147 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.930265 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.930445 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.930570 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.930752 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.930889 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.931055 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.931197 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.931355 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.931491 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.931653 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.931788 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.931954 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.932080 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.932267 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.932404 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.932570 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.932703 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.932870 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.932997 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.933170 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.933308 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.933464 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.933641 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.933787 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.933914 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.934104 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.934316 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.934443 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.934566 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.934688 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.934811 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.934980 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.935118 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.935278 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.935406 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.935608 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.935734 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.935913 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.936047 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.936211 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.936338 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.936510 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.936629 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.936813 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.936941 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.937113 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.937248 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.937424 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.937573 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.937769 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.937896 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.938086 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.938214 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.938407 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.938545 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.938716 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.938844 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.939020 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.939153 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.939326 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.939465 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.939631 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.939759 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.939936 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.940063 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.940242 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.940372 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.940585 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.940783 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.940951 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.941073 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.941237 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.941422 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.941616 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.941849 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.941977 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.942155 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.942296 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.942470 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.942597 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.942885 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.943046 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.943197 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.943374 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.943504 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.943684 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.943811 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.943998 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.944125 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.944315 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.944451 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.944627 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.944952 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.945078 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.945272 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.945409 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.945617 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.945757 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.945919 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.946056 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.946223 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.946350 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.946523 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.946653 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.946820 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.946948 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.947125 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.947266 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.947424 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.947551 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.947723 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.947860 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.948022 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.948158 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.948326 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.948505 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.948639 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.948765 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.948914 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.949048 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.949210 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.949338 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.949508 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.949678 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.949841 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.949968 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.950140 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.950269 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.950507 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.950641 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.950808 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.950935 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.951127 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.951253 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.951430 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.951556 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.951729 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.951857 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.952028 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.952155 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.952324 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.952458 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.952632 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.952764 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.952949 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.953067 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.953258 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.953382 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.953584 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.953730 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.953894 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.954022 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.954199 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.954326 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.954544 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.954714 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.954874 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.955065 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.955237 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.955426 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.955585 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.955798 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.955985 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.956666 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.956869 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.957052 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.957238 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.957408 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.957620 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.957805 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.958005 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.958170 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.958367 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.958546 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.958734 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.958922 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.959132 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.959334 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.959636 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.959834 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.960036 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.960172 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.960355 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.960490 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.960615 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.960748 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.960872 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.960872 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.961104 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.961235 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.961361 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.961484 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.961631 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.961768 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.961894 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.961894 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.962145 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.962269 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.962394 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.962517 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.962640 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.962774 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.962910 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.963036 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.963157 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.963291 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.963417 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.963555 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.963680 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.963804 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.963934 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.964059 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.964191 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.964326 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.964453 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.964577 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.964708 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.964840 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.964974 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.965105 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.965230 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.965351 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.965476 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.965661 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.965803 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.965965 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.966094 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.966265 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.966392 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.966563 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.966701 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.966867 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.967002 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.967168 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.967303 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.967480 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.967610 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.967775 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.967901 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.968075 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.968201 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.968371 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.968510 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.968671 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.968800 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.968966 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.969094 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.969267 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.969395 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.969587 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.969730 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.969886 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.970020 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.970181 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.970317 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.970478 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.970604 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.970775 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.970912 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.971078 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.971204 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.971379 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.971545 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.971675 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.972398 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.972539 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.972665 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.972789 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.972912 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.973128 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.973259 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.973428 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.973594 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.973771 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.973904 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.974059 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.974313 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.974433 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.974559 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.974692 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.974816 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.974973 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.975102 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.975316 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.975449 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.975557 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.975662 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.975857 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.975988 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.976165 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.976292 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.976469 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.976597 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.976777 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.976905 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.977077 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.977203 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.977375 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.977501 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.977715 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.977848 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.978021 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.978157 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.978327 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.978463 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.978626 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.978752 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.978929 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.979057 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.979246 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.979381 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.979550 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.979678 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.979853 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.979989 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.980158 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.980297 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.980460 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.980587 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.980761 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.980896 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.981062 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.981203 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.981366 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.981493 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.981696 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.981824 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.982000 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.982140 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.982304 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.982429 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.982608 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.982741 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.982907 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.983033 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.983212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.983333 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.983514 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.983640 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.983813 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.983948 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.984118 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.984250 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.984422 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.984547 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.984721 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.984848 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.985025 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.985157 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.985320 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.985446 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.985643 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.985777 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.985944 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.986072 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.986263 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.986402 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.986635 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.986761 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.986885 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.987009 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.987169 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.987396 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.987553 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.987679 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.987848 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.987975 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.988151 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.988382 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.988518 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.988643 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.988773 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.988905 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.989104 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.989238 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.989411 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.989577 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.989744 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.989870 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.990052 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.990189 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.990352 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.990484 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.990648 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.990774 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.990954 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.991090 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.991272 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.991398 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.991570 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.991706 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.991868 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.992002 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.992165 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.992290 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.992479 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.992605 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.992776 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.992911 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.993090 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.993216 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.993418 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.993579 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.993747 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.993886 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.994069 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.994203 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.994373 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.994575 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.994715 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.994841 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.995077 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.995204 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.995391 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.995530 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.995712 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.995837 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.996012 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.996139 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.996312 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.996448 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.996622 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.996762 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.996926 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.997055 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.997244 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.997386 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.997582 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.997792 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.997921 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.998046 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.998178 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.998311 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.998472 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.998601 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.998789 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.998918 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.999106 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.999234 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.999415 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.999544 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.999736 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:19.999863 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.000037 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.000164 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.000360 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.000489 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.000683 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.000811 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.001000 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.001129 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.001321 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.001450 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.001725 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.001865 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.002029 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.002172 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.002335 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.002463 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.002632 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.002767 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.002931 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.003165 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.003356 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.003561 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.003841 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.004037 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.004229 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.004438 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.004631 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.004827 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.005022 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.005228 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.005441 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.005623 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.005751 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.005867 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.006056 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.006358 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.006595 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.006799 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.006994 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.007183 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.007363 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.007563 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.007756 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.007889 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.007997 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.008126 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.008322 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.008515 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.008725 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.008933 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.009133 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.009133 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.009490 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.009659 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.009883 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.010083 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.010286 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.010495 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.010643 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.010643 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.010962 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.011151 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.011369 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.011555 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.011766 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.011970 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.012162 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.012360 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.012360 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.012674 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.012800 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.012941 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.013081 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.013215 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.013341 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.013486 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.013719 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.013853 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.014069 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.014196 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.014391 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.014519 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.014716 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.014845 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.015022 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.015149 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.015328 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.015456 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.015632 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.015760 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.015934 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.016053 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.016238 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.016372 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.016541 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.016676 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.016843 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.016970 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.017145 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.017283 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.017444 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.017606 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.017773 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.017903 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.018077 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.018214 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.018388 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.018514 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.019205 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.019531 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.019657 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.019841 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.019969 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.020148 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.020285 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.020451 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.020578 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.020753 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.020888 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.021095 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.021231 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.021395 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.021567 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.021750 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.021878 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.022058 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.022186 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.022379 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.022526 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.022675 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.022816 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.022992 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.023120 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.023371 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.023524 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.023690 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.023811 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.024008 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.024144 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.024320 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.024461 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.024632 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.024768 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.024940 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.025068 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.025254 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.025381 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.025586 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.025716 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.025920 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.026051 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.026466 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.026598 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.026790 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.026918 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.027175 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.027318 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.027455 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.027570 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.027703 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.027827 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.028002 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.028206 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.028343 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.029163 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.029439 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.029624 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.029812 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.030028 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.030161 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.030285 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.030410 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.030536 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.030661 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.030794 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.030929 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.031066 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.031192 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.031315 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.031423 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.031563 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.031690 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.031824 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.031959 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.032084 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.032219 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.032219 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.032463 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.032463 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.032959 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.032959 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.033223 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.033351 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.033475 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.033623 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.033765 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.033894 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.034005 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.034128 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.034277 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.035017 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.035153 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.035558 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.035711 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.035996 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.036126 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.036325 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.036532 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.036672 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.036952 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.037079 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.037263 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.037458 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.037674 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.037842 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.037973 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.038159 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.038287 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.038485 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.038620 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.038824 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.038961 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.039145 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.039284 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.039460 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.039625 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.039774 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.040094 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.040220 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.040664 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.040805 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.040981 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.041109 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.041315 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.041442 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.041663 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.041829 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.041989 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.042119 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.042307 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.042435 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.042624 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.042761 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.042949 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.043086 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.043255 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.043383 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.043557 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.043686 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.043868 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.043995 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.044175 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.044303 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.044478 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.044605 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.044794 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.044928 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.045104 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.045232 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.045405 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.045579 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.045746 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.045875 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.046054 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.046181 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.046584 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.046714 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.046929 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.047069 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.047242 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.047380 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.047566 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.047694 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.047886 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.048014 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.048199 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.048337 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.048501 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.048631 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.048820 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.048948 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.049121 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.049258 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.049421 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.049568 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.049763 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.049917 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.050121 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.050267 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.050428 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.050618 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.050746 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.050926 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.051068 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.051235 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.051364 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.051543 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.051664 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.051846 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.051983 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.052155 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.052290 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.052456 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.052597 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.052779 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.052920 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.053082 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.053217 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.053383 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.053549 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.053709 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.053865 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.054019 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.054145 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.054318 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.054444 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.054619 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.054747 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.054917 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.055052 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.055217 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.055346 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.055519 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.055655 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.055816 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.055942 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.056118 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.056245 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.056415 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.056535 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.056718 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.056845 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.057016 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.057151 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.057316 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.057451 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.057637 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.057753 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.057956 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.058083 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.058253 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.058369 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.058610 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.058740 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.058918 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.059057 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.059222 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.059349 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.059540 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.059674 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.059847 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.060052 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.060188 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.060321 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.060482 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.060619 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.060795 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.061014 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.061327 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.061455 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.061681 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.061812 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.061998 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.062135 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.062323 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.062451 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.062625 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.062753 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.062931 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.063061 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.063230 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.063365 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.063531 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.063660 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.063848 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.063975 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.064151 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.064271 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.064457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.064596 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.064761 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.064899 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.065067 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.065194 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.065371 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.066108 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.066290 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.066516 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.066633 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.066765 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.066954 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.067094 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.067267 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.067396 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.067575 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.067704 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.067883 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.068021 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.068188 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.068318 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.068497 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.068636 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.068803 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.068926 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.069118 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.069257 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.069452 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.069631 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.069793 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.069924 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.070112 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.070241 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.070424 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.070552 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.070735 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.070863 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.071039 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.071166 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.071343 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.071523 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.071652 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.071775 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.071943 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.072078 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.072254 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.072392 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.072576 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.072702 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.072882 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.073019 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.073181 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.073317 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.073629 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.073763 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.073940 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.074081 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.074256 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.074385 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.074563 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.074699 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.074868 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.074995 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.075185 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.075315 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.075496 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.075624 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.075801 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.075914 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.076115 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.076336 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.076449 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.076573 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.076728 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.076866 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.077068 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.077213 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.077397 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.077562 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.077731 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.077915 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.078045 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.078220 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.078349 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.078521 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.078650 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.078822 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.078961 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.079127 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.079256 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.079441 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.079568 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.079747 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.079885 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.080048 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.080175 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.080348 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.080485 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.080655 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.080790 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.080954 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.081083 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.081836 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.081987 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.082154 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.082367 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.082544 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.082883 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.083011 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.083192 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.083322 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.083496 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.083633 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.083799 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.083927 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.084102 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.084231 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.084411 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.084540 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.084709 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.084845 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.085009 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.085146 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.085307 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.085434 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.085629 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.085771 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.085928 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.086057 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.086224 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.086406 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.086534 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.086731 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.086867 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.087000 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.087127 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.087251 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.087436 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.087566 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.087750 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.087923 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.088057 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.088182 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.088366 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.088494 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.088703 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.088821 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.089027 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.089202 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.089349 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.089496 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.089678 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.089915 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.090015 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.090300 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.090484 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.090609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.090728 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.090923 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.091066 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.091238 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.091380 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.091547 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.091765 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.091878 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.092102 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.092197 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.092489 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.092576 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.092801 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.092896 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.093113 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.093208 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.093442 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.093557 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.093793 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.093880 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.094099 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.094187 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.094426 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.094519 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.094737 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.094853 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.095047 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.095135 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.095359 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.095444 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.095666 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.095750 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.095974 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.096060 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.096290 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.096375 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.096606 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.096801 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.096967 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.097113 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.097254 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.097405 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.097569 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.097762 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.097910 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.098095 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.098240 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.098425 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.098571 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.098725 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.098867 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.099050 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.099196 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.099376 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.099535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.099715 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.099940 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.100086 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.100233 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.100381 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.100536 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.100684 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.100827 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.100965 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.101112 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.101278 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.101450 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.101633 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.101775 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.101925 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 10:54:20.102067 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.102251 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.102561 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.102863 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 10:54:20.103106 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 10:54:20.255986 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO dbcounter [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Registered counter for database nova_api Aug 18 10:54:20.256737 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Registered counter for database nova_api Aug 18 10:54:20.278161 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_db.sqlalchemy.engines [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 10:54:20.279938 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 10:54:20.285053 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writer thread running {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 10:54:20.286662 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 10:54:20.341608 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.context [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6dc9e351-1b25-4e87-b441-33938908aec2(cell1) {{(pid=105478) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 10:54:20.342516 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.context [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6dc9e351-1b25-4e87-b441-33938908aec2(cell1) {{(pid=105479) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 10:54:20.345370 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 10:54:20.345862 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 10:54:20.346355 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 10:54:20.347340 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 10:54:20.348229 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 10:54:20.348946 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 10:54:20.349062 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 10:54:20.349388 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 10:54:20.349725 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 10:54:20.350160 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 10:54:20.351391 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 10:54:20.352112 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 10:54:20.353388 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO dbcounter [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Registered counter for database nova_cell0 Aug 18 10:54:20.354171 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Registered counter for database nova_cell0 Aug 18 10:54:20.358901 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO dbcounter [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Registered counter for database nova_cell1 Aug 18 10:54:20.359689 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Registered counter for database nova_cell1 Aug 18 10:54:20.367035 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_db.sqlalchemy.engines [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 10:54:20.368675 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_db.sqlalchemy.engines [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 10:54:20.370313 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 10:54:20.373796 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 10:54:20.374961 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writer thread running {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 10:54:20.376229 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 10:54:20.377216 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writer thread running {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 10:54:20.516143 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 10:54:20.522374 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO dbcounter [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Registered counter for database nova_cell0 Aug 18 10:54:20.526046 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Registered counter for database nova_cell0 Aug 18 10:54:20.531849 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_db.sqlalchemy.engines [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 10:54:20.536499 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writer thread running {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 10:54:20.536626 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 10:54:20.540943 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 10:54:20.872788 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 10:54:20.873826 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: WARNING keystonemiddleware.auth_token [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 10:54:20.880505 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 10:54:20.881559 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: WARNING keystonemiddleware.auth_token [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 10:54:21.224268 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 10:54:21.224505 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: WARNING keystonemiddleware.auth_token [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 10:54:21.230259 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 10:54:21.230433 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: WARNING keystonemiddleware.auth_token [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 10:54:21.235523 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55651b24d9c0 pid: 105479 (default app) Aug 18 10:54:21.235636 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55651b24d9c0 pid: 105478 (default app) Aug 18 10:54:21.237719 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:54:21.238840 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-37b77887-9040-4b53-9f50-c9d4e60ddb5f None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001796 Aug 18 10:54:21.239249 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Thu Aug 18 10:54:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:55:41.615187 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:55:41.616402 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Aug 18 10:55:41.616992 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 10:55:41.629058 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:SELECT=3 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:41.630066 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell0:SELECT=3 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:41.631348 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell1:SELECT=3 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:41.632275 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:42.519166 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-9577d92c-34d0-42ec-b9e1-5051f89d0f6c admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:55:42.551473 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-9577d92c-34d0-42ec-b9e1-5051f89d0f6c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927556 Aug 18 10:55:42.552563 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 2/3] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Aug 18 10:55:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:55:44.972195 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:55:44.973722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-06382ce8-f7a3-4802-8b09-8c9c757a6b31 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Aug 18 10:55:44.974153 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 2/4] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:55:45.546798 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-d47f0752-721c-4850-a285-f04564309e0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "disk": 1}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:55:45.573647 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:55:45.573647 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: warnings.warn(msg) Aug 18 10:55:45.610967 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-d47f0752-721c-4850-a285-f04564309e0d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.630082 Aug 18 10:55:45.611597 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 3/5] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Aug 18 10:55:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:55:45.628565 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_api:SELECT=3 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:45.629730 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_cell0:SELECT=3 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:45.631650 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_cell1:SELECT=3 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:45.632455 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:55:45.895588 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-b35309d0-a610-4689-94eb-deddeb5f6ab2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:55:45.900327 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:55:45.900327 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: warnings.warn(msg) Aug 18 10:55:45.982546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-b35309d0-a610-4689-94eb-deddeb5f6ab2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.360744 Aug 18 10:55:45.983538 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 3/6] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Aug 18 10:55:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:55:48.422189 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-d47f0752-721c-4850-a285-f04564309e0d admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:55:48.423125 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-d47f0752-721c-4850-a285-f04564309e0d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 18 10:55:48.423530 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 4/7] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:55:49.125884 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ccf1c04c-200f-4f12-af54-a4880727ca3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "swap": 0, "ram": 512, "vcpus": 1, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:55:49.147523 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:55:49.147523 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: warnings.warn(msg) Aug 18 10:55:49.167912 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ccf1c04c-200f-4f12-af54-a4880727ca3e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.736876 Aug 18 10:55:49.173586 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 4/8] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Aug 18 10:55:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:55:49.181876 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-6e44ead1-a45b-4fa4-865d-abdb8f3f9dd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:55:49.185231 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 10:55:49.185231 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: warnings.warn(msg) Aug 18 10:55:49.232278 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-6e44ead1-a45b-4fa4-865d-abdb8f3f9dd3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054355 Aug 18 10:55:49.233127 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 5/9] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Aug 18 10:55:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:55:51.806882 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ccf1c04c-200f-4f12-af54-a4880727ca3e admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:55:51.807879 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ccf1c04c-200f-4f12-af54-a4880727ca3e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 18 10:55:51.808279 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:55:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:55:52.214384 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-8fb48037-d4a2-48d9-bd8e-439dcedda2c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:55:52.233312 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-8fb48037-d4a2-48d9-bd8e-439dcedda2c6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.418941 Aug 18 10:55:52.233899 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 6/11] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Aug 18 10:55:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 10:55:52.246350 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-060629af-770d-473c-84fd-917b012b39a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:55:52.272009 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-060629af-770d-473c-84fd-917b012b39a8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029228 Aug 18 10:55:52.272783 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 6/12] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Aug 18 10:55:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 10:55:54.659034 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-8fb48037-d4a2-48d9-bd8e-439dcedda2c6 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:55:54.661477 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-8fb48037-d4a2-48d9-bd8e-439dcedda2c6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002526 Aug 18 10:55:54.661477 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 7/13] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:55:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:55:55.127210 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-da8d0068-6ce8-487d-b638-1b4d3b268c69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:55:55.148411 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-da8d0068-6ce8-487d-b638-1b4d3b268c69 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478878 Aug 18 10:55:55.149167 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 7/14] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Aug 18 10:55:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:55:55.164569 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-bb6b6917-6c3d-4f7f-b3ea-ae1dbec46799 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:55:55.191708 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-bb6b6917-6c3d-4f7f-b3ea-ae1dbec46799 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034033 Aug 18 10:55:55.193019 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 8/15] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Aug 18 10:55:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:55:57.601993 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-da8d0068-6ce8-487d-b638-1b4d3b268c69 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:55:57.602971 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-da8d0068-6ce8-487d-b638-1b4d3b268c69 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 18 10:55:57.603637 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 8/16] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:55:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:55:58.070236 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-78cf8074-898d-4978-ad88-ce08ca081a62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:55:58.091745 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-78cf8074-898d-4978-ad88-ce08ca081a62 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481608 Aug 18 10:55:58.092791 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 9/17] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Aug 18 10:55:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:55:58.104938 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-558b1375-abe6-4ef1-b009-0d1fb1a4c1fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:55:58.132201 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-558b1375-abe6-4ef1-b009-0d1fb1a4c1fc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030695 Aug 18 10:55:58.147594 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 9/18] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Aug 18 10:55:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 10:56:00.999154 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-78cf8074-898d-4978-ad88-ce08ca081a62 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:01.000547 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-78cf8074-898d-4978-ad88-ce08ca081a62 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002136 Aug 18 10:56:01.001155 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 10/19] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:56:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:01.451322 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-a9377401-3baf-4b14-aa88-1db4a1292094 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:01.478787 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-a9377401-3baf-4b14-aa88-1db4a1292094 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.469155 Aug 18 10:56:01.479301 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 10/20] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Aug 18 10:56:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 10:56:04.134279 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-78cf8074-898d-4978-ad88-ce08ca081a62 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:04.135288 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-78cf8074-898d-4978-ad88-ce08ca081a62 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 18 10:56:04.135693 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 11/21] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:56:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:04.572517 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-7ecd76dd-d9cb-487e-a36a-c6685195c13f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:04.601245 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-7ecd76dd-d9cb-487e-a36a-c6685195c13f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.459134 Aug 18 10:56:04.603049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 11/22] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Aug 18 10:56:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:56:04.615010 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-a5a734f9-ce31-4984-bc25-1b4f593741d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:04.640749 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-a5a734f9-ce31-4984-bc25-1b4f593741d7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030264 Aug 18 10:56:04.641436 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 12/23] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Aug 18 10:56:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:56:07.001775 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-7ecd76dd-d9cb-487e-a36a-c6685195c13f admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:07.002847 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-7ecd76dd-d9cb-487e-a36a-c6685195c13f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 18 10:56:07.003249 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:56:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:07.429911 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-2523373d-c597-445e-918e-f0c30b6c9020 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:07.448826 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-2523373d-c597-445e-918e-f0c30b6c9020 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.439339 Aug 18 10:56:07.449579 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 13/25] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Aug 18 10:56:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:56:07.462041 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-3f79407a-f0d0-4c7b-8193-4ffb69679b3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:07.486599 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-3f79407a-f0d0-4c7b-8193-4ffb69679b3e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028083 Aug 18 10:56:07.487456 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 13/26] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Aug 18 10:56:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:56:09.898332 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-2523373d-c597-445e-918e-f0c30b6c9020 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:09.900249 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-2523373d-c597-445e-918e-f0c30b6c9020 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002431 Aug 18 10:56:09.900916 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 14/27] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:56:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 10:56:10.368674 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-35a2bcf5-e29f-4449-ba4a-451c31d8b101 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:10.392272 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-35a2bcf5-e29f-4449-ba4a-451c31d8b101 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.484478 Aug 18 10:56:10.402073 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 14/28] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Aug 18 10:56:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:56:10.410136 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-1158c5d7-a18d-4531-99c8-a06ad12d47a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:10.437813 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-1158c5d7-a18d-4531-99c8-a06ad12d47a3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032940 Aug 18 10:56:10.453544 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 15/29] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Aug 18 10:56:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:56:12.862462 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-35a2bcf5-e29f-4449-ba4a-451c31d8b101 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:12.864153 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-35a2bcf5-e29f-4449-ba4a-451c31d8b101 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002332 Aug 18 10:56:12.864560 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 15/30] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:56:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:13.347451 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-f2aadb0d-def2-4f59-b04f-56601e4931a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:13.355730 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:13.373721 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-f2aadb0d-def2-4f59-b04f-56601e4931a1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.502734 Aug 18 10:56:13.381594 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 16/31] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Aug 18 10:56:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:56:13.389858 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-c38f7556-4c32-4d9e-9a3a-973375a8fc09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:13.420212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-c38f7556-4c32-4d9e-9a3a-973375a8fc09 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033999 Aug 18 10:56:13.420796 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 16/32] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Aug 18 10:56:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:56:15.908616 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-f2aadb0d-def2-4f59-b04f-56601e4931a1 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:15.909841 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-f2aadb0d-def2-4f59-b04f-56601e4931a1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Aug 18 10:56:15.910249 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 17/33] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:56:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:16.374190 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-9ee5925a-1dd4-410b-8735-d625fe160dc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:16.381051 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:16.397979 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-9ee5925a-1dd4-410b-8735-d625fe160dc3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.479079 Aug 18 10:56:16.399238 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 17/34] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Aug 18 10:56:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:56:16.412801 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-5c48fc9a-be51-4ba2-a338-6a052e451300 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:16.439950 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-5c48fc9a-be51-4ba2-a338-6a052e451300 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031979 Aug 18 10:56:16.440544 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 18/35] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Aug 18 10:56:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 10:56:35.135912 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-9ee5925a-1dd4-410b-8735-d625fe160dc3 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:35.136917 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-9ee5925a-1dd4-410b-8735-d625fe160dc3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 18 10:56:35.137321 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 18/36] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:56:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:35.148267 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:56:35.543567 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-e741cd0c-2fa2-4468-abd4-5d1df20c4752 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:35.565224 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-e741cd0c-2fa2-4468-abd4-5d1df20c4752 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.421292 Aug 18 10:56:35.565815 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 19/37] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Aug 18 10:56:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 10:56:36.649378 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-9ee5925a-1dd4-410b-8735-d625fe160dc3 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:36.650429 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-9ee5925a-1dd4-410b-8735-d625fe160dc3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 18 10:56:36.650827 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 19/38] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 10:56:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:37.191419 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-8c0bdd29-65c7-43bd-9704-7b15d74bafd1 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:37.197025 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.wsgi [None req-8c0bdd29-65c7-43bd-9704-7b15d74bafd1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-8c0bdd29-65c7-43bd-9704-7b15d74bafd1 admin admin] Request method failure captured: Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Accept: application/json Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Accept-Encoding: gzip, deflate Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Connection: keep-alive Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Content-Length: 0 Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Host: 10.222.0.15 Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Openstack-Api-Version: compute 2.90 Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Openstack-System-Scope: None Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: User-Agent: python-novaclient Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Auth-Token: gAAAAABi_hrkmtzGXNtP_yhufKoAmXWtFAYW8ZYIiMQRUO9KdiG3xXlBpSA_h89KUDN9OA55FoCxINoeMlOLL1lB7nxO3bTWio0Ugi1qe_ZCrEA8PI6B8jb0esfCoSWREdW44jzWQkt93pp9ELHT4d7zCda-jhTiOz0NjSV44WjyF6WQmj0vnmg Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Domain-Id: None Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Domain-Name: None Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Identity-Status: Confirmed Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Is-Admin-Project: True Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Domain-Id: default Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Domain-Name: Default Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Name: admin Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Role: admin,member,reader Aug 18 10:56:37.200306 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Roles: admin,member,reader Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8a5400fd95e746d7a23658c890ad84cd", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8a5400fd95e746d7a23658c890ad84cd"}]}] Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Tenant: admin Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Tenant-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Tenant-Name: admin Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User: admin Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Domain-Id: default Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Domain-Name: Default Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Id: 55b16d3a97d74b659d9af679ed207645 Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Name: admin Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: method: > Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: exception: Flavor 42 could not be found. Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: action_args: {'id': '42'} Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 10:56:37.202024 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:37.203042 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:37.204438 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-8c0bdd29-65c7-43bd-9704-7b15d74bafd1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 10:56:37.205755 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-8c0bdd29-65c7-43bd-9704-7b15d74bafd1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.414299 Aug 18 10:56:37.205755 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 20/39] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Aug 18 10:56:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:37.211618 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-c6cdc593-7f10-4880-84c9-0c0ef8df2974 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:37.235880 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-c6cdc593-7f10-4880-84c9-0c0ef8df2974 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027234 Aug 18 10:56:37.236440 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 20/40] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Aug 18 10:56:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 10:56:37.246824 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-02af17dd-bf6c-4aea-a839-f48add78ac21 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:37.271428 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-02af17dd-bf6c-4aea-a839-f48add78ac21 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028195 Aug 18 10:56:37.272002 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 21/41] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Aug 18 10:56:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 10:56:37.281475 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-71a1c031-ca6f-409a-9db7-b8c62562ec33 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:37.287945 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.wsgi [None req-71a1c031-ca6f-409a-9db7-b8c62562ec33 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-71a1c031-ca6f-409a-9db7-b8c62562ec33 admin admin] Request method failure captured: Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Accept: application/json Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Accept-Encoding: gzip, deflate Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Connection: keep-alive Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Content-Length: 0 Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Host: 10.222.0.15 Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Openstack-Api-Version: compute 2.90 Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Openstack-System-Scope: None Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: User-Agent: python-novaclient Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Auth-Token: gAAAAABi_hrkmtzGXNtP_yhufKoAmXWtFAYW8ZYIiMQRUO9KdiG3xXlBpSA_h89KUDN9OA55FoCxINoeMlOLL1lB7nxO3bTWio0Ugi1qe_ZCrEA8PI6B8jb0esfCoSWREdW44jzWQkt93pp9ELHT4d7zCda-jhTiOz0NjSV44WjyF6WQmj0vnmg Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Domain-Id: None Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Domain-Name: None Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Identity-Status: Confirmed Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Is-Admin-Project: True Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Domain-Id: default Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Domain-Name: Default Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Name: admin Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Role: admin,member,reader Aug 18 10:56:37.291212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Roles: admin,member,reader Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8a5400fd95e746d7a23658c890ad84cd", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8a5400fd95e746d7a23658c890ad84cd"}]}] Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Tenant: admin Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Tenant-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Tenant-Name: admin Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User: admin Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Domain-Id: default Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Domain-Name: Default Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Id: 55b16d3a97d74b659d9af679ed207645 Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Name: admin Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: method: > Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: exception: Flavor 42 could not be found. Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: action_args: {'id': '42'} Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 10:56:37.292722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:37.293609 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:37.294669 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-71a1c031-ca6f-409a-9db7-b8c62562ec33 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 10:56:37.295624 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-71a1c031-ca6f-409a-9db7-b8c62562ec33 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014716 Aug 18 10:56:37.295624 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 21/42] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Aug 18 10:56:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 18 10:56:38.317277 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-02af17dd-bf6c-4aea-a839-f48add78ac21 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:38.318309 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-02af17dd-bf6c-4aea-a839-f48add78ac21 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 18 10:56:38.318732 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 22/43] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 10:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:38.852603 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ecd0ce8e-4851-4802-8d2b-59028acdad37 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:38.858031 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.wsgi [None req-ecd0ce8e-4851-4802-8d2b-59028acdad37 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ecd0ce8e-4851-4802-8d2b-59028acdad37 admin admin] Request method failure captured: Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Accept: application/json Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Accept-Encoding: gzip, deflate Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Connection: keep-alive Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Content-Length: 0 Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Host: 10.222.0.15 Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Openstack-Api-Version: compute 2.90 Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Openstack-System-Scope: None Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: User-Agent: python-novaclient Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Auth-Token: gAAAAABi_hrm0SdC6n7__JbguA_Rw-FZst9Zj1RrscqvIPP6bEZUIYUTWEiX9ziwYWiCe0tvCDRk4Xe4kzdmlQ8ImOQ1AtxGsV2W5Vv8Mn9RNxV1o7H-MgBJnCclhnpDbDs8uQ51go8e330DLvpW7mHH2Nt5ctMzWk6SR3BNcayIyD104k14C-c Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Domain-Id: None Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Domain-Name: None Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Identity-Status: Confirmed Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Is-Admin-Project: True Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Domain-Id: default Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Domain-Name: Default Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Name: admin Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Role: admin,member,reader Aug 18 10:56:38.859522 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Roles: admin,member,reader Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8a5400fd95e746d7a23658c890ad84cd", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8a5400fd95e746d7a23658c890ad84cd"}]}] Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Tenant: admin Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Tenant-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Tenant-Name: admin Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User: admin Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Domain-Id: default Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Domain-Name: Default Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Id: 55b16d3a97d74b659d9af679ed207645 Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Name: admin Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: method: > Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: exception: Flavor 84 could not be found. Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: action_args: {'id': '84'} Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 10:56:38.861611 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:38.862574 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:38.864331 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ecd0ce8e-4851-4802-8d2b-59028acdad37 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 10:56:38.865704 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ecd0ce8e-4851-4802-8d2b-59028acdad37 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.405103 Aug 18 10:56:38.865704 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 22/44] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Aug 18 10:56:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:38.871227 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-ed6429d4-aefc-44a4-854b-b7642d94ac5d admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:38.886731 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-ed6429d4-aefc-44a4-854b-b7642d94ac5d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019022 Aug 18 10:56:38.887294 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 23/45] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Aug 18 10:56:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 10:56:38.896856 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-128d80c5-e9ea-442b-a76a-94526b8a34b9 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:38.912358 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-128d80c5-e9ea-442b-a76a-94526b8a34b9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018978 Aug 18 10:56:38.912903 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Aug 18 10:56:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 10:56:38.922488 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b7e60094-578e-4c71-8794-3130f13a150c admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:38.928435 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.wsgi [None req-b7e60094-578e-4c71-8794-3130f13a150c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b7e60094-578e-4c71-8794-3130f13a150c admin admin] Request method failure captured: Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Accept: application/json Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Accept-Encoding: gzip, deflate Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Connection: keep-alive Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Content-Length: 0 Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Host: 10.222.0.15 Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Openstack-Api-Version: compute 2.90 Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Openstack-System-Scope: None Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: User-Agent: python-novaclient Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Auth-Token: gAAAAABi_hrm0SdC6n7__JbguA_Rw-FZst9Zj1RrscqvIPP6bEZUIYUTWEiX9ziwYWiCe0tvCDRk4Xe4kzdmlQ8ImOQ1AtxGsV2W5Vv8Mn9RNxV1o7H-MgBJnCclhnpDbDs8uQ51go8e330DLvpW7mHH2Nt5ctMzWk6SR3BNcayIyD104k14C-c Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Domain-Id: None Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Domain-Name: None Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Identity-Status: Confirmed Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Is-Admin-Project: True Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Domain-Id: default Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Domain-Name: Default Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Name: admin Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Role: admin,member,reader Aug 18 10:56:38.929963 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Roles: admin,member,reader Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8a5400fd95e746d7a23658c890ad84cd", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8a5400fd95e746d7a23658c890ad84cd"}]}] Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Tenant: admin Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Tenant-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Tenant-Name: admin Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User: admin Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Domain-Id: default Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Domain-Name: Default Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Id: 55b16d3a97d74b659d9af679ed207645 Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Name: admin Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: method: > Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: exception: Flavor 84 could not be found. Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: action_args: {'id': '84'} Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 10:56:38.931457 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:38.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:38.933762 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b7e60094-578e-4c71-8794-3130f13a150c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 10:56:38.934793 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-b7e60094-578e-4c71-8794-3130f13a150c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012369 Aug 18 10:56:38.934793 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 24/47] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Aug 18 10:56:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:39.924358 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-128d80c5-e9ea-442b-a76a-94526b8a34b9 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:39.925359 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-128d80c5-e9ea-442b-a76a-94526b8a34b9 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 18 10:56:39.925836 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 24/48] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 10:56:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 10:56:40.466451 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-2c9cabce-4c4b-4c0e-88e8-a1406d58a0cf admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:40.472396 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.wsgi [None req-2c9cabce-4c4b-4c0e-88e8-a1406d58a0cf admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-2c9cabce-4c4b-4c0e-88e8-a1406d58a0cf admin admin] Request method failure captured: Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Accept: application/json Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Accept-Encoding: gzip, deflate Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Connection: keep-alive Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Content-Length: 0 Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Host: 10.222.0.15 Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Openstack-Api-Version: compute 2.90 Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Openstack-System-Scope: None Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: User-Agent: python-novaclient Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Auth-Token: gAAAAABi_hrni5PwbO46iJrletHCdeeHUcgDkSDN2JiPBGJgpcfzfJknuIaYCZPv1X8M11odCZEmuuc0J4deFrLAUhSEyXPkoVGyMn7fiQJtzx7bg3qrnqBItg1MSZd3dJ2tuYwQmYL1P-F5XhdL5RJ-M3ZgU2tNCS8oiXqWP4dJluG9o6yNdPw Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Domain-Id: None Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Domain-Name: None Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Identity-Status: Confirmed Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Is-Admin-Project: True Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Domain-Id: default Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Domain-Name: Default Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Project-Name: admin Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Role: admin,member,reader Aug 18 10:56:40.473942 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Roles: admin,member,reader Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8a5400fd95e746d7a23658c890ad84cd", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8a5400fd95e746d7a23658c890ad84cd"}]}] Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Tenant: admin Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Tenant-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-Tenant-Name: admin Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User: admin Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Domain-Id: default Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Domain-Name: Default Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Id: 55b16d3a97d74b659d9af679ed207645 Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: X-User-Name: admin Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: method: > Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: exception: Flavor 451 could not be found. Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: action_args: {'id': '451'} Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 10:56:40.475535 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:40.476513 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Aug 18 10:56:40.477887 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-2c9cabce-4c4b-4c0e-88e8-a1406d58a0cf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 10:56:40.479147 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-2c9cabce-4c4b-4c0e-88e8-a1406d58a0cf admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.412954 Aug 18 10:56:40.479147 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 25/49] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Aug 18 10:56:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 10:56:40.485067 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-c305e8e6-8f03-43b1-b49f-0d593739670e admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:40.500848 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-c305e8e6-8f03-43b1-b49f-0d593739670e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019266 Aug 18 10:56:40.502084 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 25/50] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Aug 18 10:56:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 10:56:40.511501 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:40.527325 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019286 Aug 18 10:56:40.527858 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 26/51] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Aug 18 10:56:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 10:56:40.538364 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-d208c6d9-178c-4344-bc2e-09226e9d9fd4 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:40.543783 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.wsgi [None req-d208c6d9-178c-4344-bc2e-09226e9d9fd4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-d208c6d9-178c-4344-bc2e-09226e9d9fd4 admin admin] Request method failure captured: Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Accept: application/json Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Accept-Encoding: gzip, deflate Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Connection: keep-alive Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Content-Length: 0 Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Host: 10.222.0.15 Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Openstack-Api-Version: compute 2.90 Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Openstack-System-Scope: None Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: User-Agent: python-novaclient Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Auth-Token: gAAAAABi_hrni5PwbO46iJrletHCdeeHUcgDkSDN2JiPBGJgpcfzfJknuIaYCZPv1X8M11odCZEmuuc0J4deFrLAUhSEyXPkoVGyMn7fiQJtzx7bg3qrnqBItg1MSZd3dJ2tuYwQmYL1P-F5XhdL5RJ-M3ZgU2tNCS8oiXqWP4dJluG9o6yNdPw Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Domain-Id: None Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Domain-Name: None Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Identity-Status: Confirmed Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Is-Admin-Project: True Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Domain-Id: default Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Domain-Name: Default Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Project-Name: admin Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Role: admin,member,reader Aug 18 10:56:40.545264 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Roles: admin,member,reader Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8a5400fd95e746d7a23658c890ad84cd", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8a5400fd95e746d7a23658c890ad84cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8a5400fd95e746d7a23658c890ad84cd"}]}] Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Tenant: admin Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Tenant-Id: 8a5400fd95e746d7a23658c890ad84cd Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-Tenant-Name: admin Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User: admin Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Domain-Id: default Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Domain-Name: Default Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Id: 55b16d3a97d74b659d9af679ed207645 Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: X-User-Name: admin Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: method: > Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: exception: Flavor 451 could not be found. Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: action_args: {'id': '451'} Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 10:56:40.546854 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:40.548049 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Aug 18 10:56:40.549546 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-d208c6d9-178c-4344-bc2e-09226e9d9fd4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 10:56:40.550773 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-d208c6d9-178c-4344-bc2e-09226e9d9fd4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011858 Aug 18 10:56:40.550773 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 26/52] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Aug 18 10:56:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 18 10:56:41.528877 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:41.529901 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 18 10:56:41.530300 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 27/53] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 10:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:42.065582 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-07827d45-8465-4357-a444-b85af7332b9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:42.084963 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-07827d45-8465-4357-a444-b85af7332b9d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.416134 Aug 18 10:56:42.085439 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 27/54] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Aug 18 10:56:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:56:43.097930 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:43.098999 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 18 10:56:43.099401 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 10:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:43.640157 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-b0ed9147-0fc7-40a8-9590-b4d4f6188b8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:43.659947 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-b0ed9147-0fc7-40a8-9590-b4d4f6188b8c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.419948 Aug 18 10:56:43.660497 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 28/56] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Aug 18 10:56:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:56:44.648830 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:44.649889 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 18 10:56:44.650290 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 29/57] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 10:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:45.177848 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-7f1baa09-6601-4363-9e28-11b9d0fdd176 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:45.197212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-7f1baa09-6601-4363-9e28-11b9d0fdd176 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406586 Aug 18 10:56:45.197791 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 29/58] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Aug 18 10:56:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:56:46.218870 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:46.220658 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Aug 18 10:56:46.221093 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 30/59] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 10:56:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:46.797505 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-9ddfa2a2-d4b0-4fc5-a275-e1a0c08e509b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 10:56:46.821930 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-9ddfa2a2-d4b0-4fc5-a275-e1a0c08e509b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.455857 Aug 18 10:56:46.822851 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 30/60] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Aug 18 10:56:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 10:56:47.827299 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:47.828296 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 18 10:56:47.828752 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 31/61] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 10:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:56:48.367139 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-4f3b75e7-e618-4a5b-a3a6-1d7772447083 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:56:48.388996 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-4f3b75e7-e618-4a5b-a3a6-1d7772447083 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.420713 Aug 18 10:56:48.389552 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 31/62] 10.222.0.15 () {60 vars in 1202 bytes} [Thu Aug 18 10:56:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 10:57:43.292030 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:57:43.293039 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-b872e350-91af-4f6a-90b1-d5f6574ca925 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 18 10:57:43.293444 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 32/63] 10.222.0.15 () {54 vars in 931 bytes} [Thu Aug 18 10:57:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 10:57:43.304668 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:43.702151 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ff100dfb-69a3-4fbf-9284-d638454952d8 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:57:43.722748 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ff100dfb-69a3-4fbf-9284-d638454952d8 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.422492 Aug 18 10:57:43.723203 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 32/64] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Aug 18 10:57:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 10:57:43.744421 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:SELECT=14 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 10:57:43.748392 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-77a4f1ca-56c1-42d1-9408-a94a02b53ff4 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:57:43.756143 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-77a4f1ca-56c1-42d1-9408-a94a02b53ff4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013096 Aug 18 10:57:43.756673 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 33/65] 10.222.0.15 () {60 vars in 1283 bytes} [Thu Aug 18 10:57:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:57:43.768924 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-6e35c1fd-2a1f-4f7c-aaf2-2fd8160ce75a admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:57:43.776601 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-6e35c1fd-2a1f-4f7c-aaf2-2fd8160ce75a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011312 Aug 18 10:57:43.777123 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 33/66] 10.222.0.15 () {60 vars in 1286 bytes} [Thu Aug 18 10:57:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:57:43.789501 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-d75893db-726f-4953-8d89-23269a58828b admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:57:43.797642 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-d75893db-726f-4953-8d89-23269a58828b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011096 Aug 18 10:57:43.798238 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 34/67] 10.222.0.15 () {60 vars in 1286 bytes} [Thu Aug 18 10:57:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 10:57:43.809775 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-a0927657-e865-4ea3-bb1d-5d81a9ff8d8c admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 10:57:43.817647 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-a0927657-e865-4ea3-bb1d-5d81a9ff8d8c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011527 Aug 18 10:57:43.818164 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 34/68] 10.222.0.15 () {60 vars in 1283 bytes} [Thu Aug 18 10:57:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:00:42.497980 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-d75893db-726f-4953-8d89-23269a58828b admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:00:42.499000 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-d75893db-726f-4953-8d89-23269a58828b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 18 11:00:42.499463 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 35/69] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 11:00:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:00:42.641606 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_api:SELECT=6 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:00:42.801999 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-7625459f-a47b-4102-912a-371054f129f0 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:00:42.804371 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:00:42.804371 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: warnings.warn(msg) Aug 18 11:00:42.805674 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-7625459f-a47b-4102-912a-371054f129f0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:00:42.806180 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-7625459f-a47b-4102-912a-371054f129f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:00:42.806599 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-7625459f-a47b-4102-912a-371054f129f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:00:42.807302 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-7625459f-a47b-4102-912a-371054f129f0 admin admin] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:00:42.807736 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-7625459f-a47b-4102-912a-371054f129f0 admin admin] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:00:42.808140 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-7625459f-a47b-4102-912a-371054f129f0 admin admin] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:00:42.843453 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-7625459f-a47b-4102-912a-371054f129f0 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.203261 Aug 18 11:00:42.844006 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 35/70] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Aug 18 11:00:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:00:43.714451 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-d75893db-726f-4953-8d89-23269a58828b admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:00:43.715469 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-d75893db-726f-4953-8d89-23269a58828b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Aug 18 11:00:43.715870 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 36/71] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 11:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:00:43.920969 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-0e62c454-8645-466f-977e-f653d5a04266 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:00:43.923360 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:00:43.923360 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: warnings.warn(msg) Aug 18 11:00:43.924461 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-0e62c454-8645-466f-977e-f653d5a04266 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:00:43.924936 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-0e62c454-8645-466f-977e-f653d5a04266 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:00:43.925360 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-0e62c454-8645-466f-977e-f653d5a04266 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:00:43.926106 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-0e62c454-8645-466f-977e-f653d5a04266 admin admin] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:00:43.926549 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-0e62c454-8645-466f-977e-f653d5a04266 admin admin] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:00:43.926962 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-0e62c454-8645-466f-977e-f653d5a04266 admin admin] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:00:43.946717 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-0e62c454-8645-466f-977e-f653d5a04266 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.083128 Aug 18 11:00:43.947299 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 36/72] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Aug 18 11:00:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:00:55.208500 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-d75893db-726f-4953-8d89-23269a58828b admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:00:55.209551 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-d75893db-726f-4953-8d89-23269a58828b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 18 11:00:55.209957 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 37/73] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 11:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:00:55.356966 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_cell0:SELECT=4 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:00:55.357720 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_cell1:SELECT=4 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:00:55.358379 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_api:SELECT=8 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:00:55.407427 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-828754fa-98ab-40da-aa12-5decf735da61 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:00:55.409903 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:00:55.409903 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: warnings.warn(msg) Aug 18 11:00:55.411024 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-828754fa-98ab-40da-aa12-5decf735da61 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:00:55.411485 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-828754fa-98ab-40da-aa12-5decf735da61 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:00:55.412150 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-828754fa-98ab-40da-aa12-5decf735da61 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:00:55.412839 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-828754fa-98ab-40da-aa12-5decf735da61 admin admin] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:00:55.413269 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-828754fa-98ab-40da-aa12-5decf735da61 admin admin] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:00:55.413722 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-828754fa-98ab-40da-aa12-5decf735da61 admin admin] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:00:55.438124 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-828754fa-98ab-40da-aa12-5decf735da61 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085698 Aug 18 11:00:55.438606 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 37/74] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Aug 18 11:00:55 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:00:56.268483 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-d75893db-726f-4953-8d89-23269a58828b admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:00:56.269493 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-d75893db-726f-4953-8d89-23269a58828b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 18 11:00:56.269926 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 38/75] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Aug 18 11:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:00:56.468798 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-74321a08-8331-4077-827e-c109b3597acd admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:00:56.471212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:00:56.471212 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: warnings.warn(msg) Aug 18 11:00:56.472328 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-74321a08-8331-4077-827e-c109b3597acd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:00:56.472815 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-74321a08-8331-4077-827e-c109b3597acd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:00:56.473241 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-74321a08-8331-4077-827e-c109b3597acd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:00:56.473977 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-74321a08-8331-4077-827e-c109b3597acd admin admin] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:00:56.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-74321a08-8331-4077-827e-c109b3597acd admin admin] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:00:56.474827 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-74321a08-8331-4077-827e-c109b3597acd admin admin] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:00:56.497917 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-74321a08-8331-4077-827e-c109b3597acd admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080869 Aug 18 11:00:56.498482 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 38/76] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Aug 18 11:00:56 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:01:54.361839 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: Thu Aug 18 11:01:54 2022 - graceful shutdown triggered... Aug 18 11:01:54.361627 dv-cinder-826608-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 18 11:01:54.362782 dv-cinder-826608-10-iscsi devstack@n-api.service[105479]: Gracefully killing worker 2 (pid: 105479)... Aug 18 11:01:54.363138 dv-cinder-826608-10-iscsi devstack@n-api.service[105478]: Gracefully killing worker 1 (pid: 105478)... Aug 18 11:01:55.362630 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: worker 1 buried after 1 seconds Aug 18 11:01:55.363180 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: worker 2 buried after 1 seconds Aug 18 11:01:55.363180 dv-cinder-826608-10-iscsi devstack@n-api.service[105477]: goodbye to uWSGI. Aug 18 11:01:55.364282 dv-cinder-826608-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 18 11:01:55.364839 dv-cinder-826608-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 18 11:01:55.367744 dv-cinder-826608-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 11:01:55.377149 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 11:01:55.379792 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 11:01:55 2022] *** Aug 18 11:01:55.379962 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: nodename: dv-cinder-826608-10-iscsi Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: machine: x86_64 Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: clock source: unix Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: pcre jit disabled Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: detected number of CPU cores: 4 Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: current working directory: / Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: detected binary path: /usr/bin/uwsgi-core Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: your processes number limit is 47680 Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: your memory page size is 4096 bytes Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: detected max file descriptor number: 2048 Aug 18 11:01:55.380121 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: lock engine: pthread robust mutexes Aug 18 11:01:55.380888 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: thunder lock: enabled Aug 18 11:01:55.380888 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 11:01:55.380888 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 11:01:55.422816 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: Python main interpreter initialized at 0x557eab7709c0 Aug 18 11:01:55.422816 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: python threads support enabled Aug 18 11:01:55.422816 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: your server socket listen backlog is limited to 100 connections Aug 18 11:01:55.422816 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: your mercy for graceful operations on workers is 90 seconds Aug 18 11:01:55.423254 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 11:01:55.423254 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: *** Operational MODE: preforking *** Aug 18 11:01:55.423512 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: *** uWSGI is running in multiple interpreter mode *** Aug 18 11:01:55.423512 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: spawned uWSGI master process (pid: 120789) Aug 18 11:01:55.423727 dv-cinder-826608-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 11:01:55.424297 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: spawned uWSGI worker 1 (pid: 120800, cores: 1) Aug 18 11:01:55.424646 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: spawned uWSGI worker 2 (pid: 120801, cores: 1) Aug 18 11:01:55.426812 dv-cinder-826608-10-iscsi devstack@n-api.service[120789]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 11:01:56.110227 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 11:01:56.133356 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 11:01:57.277201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:01:57.277201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: from cryptography.utils import int_from_bytes Aug 18 11:01:57.277865 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:01:57.277865 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: from cryptography.utils import int_from_bytes Aug 18 11:01:57.339670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:01:57.339670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: from cryptography.utils import int_from_bytes Aug 18 11:01:57.340209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:01:57.340209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: from cryptography.utils import int_from_bytes Aug 18 11:01:59.662172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 11:01:59.663071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 11:01:59.663857 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 11:01:59.664261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 11:01:59.664526 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 11:01:59.664922 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.665277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.665642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.665975 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.666313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.666729 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.666985 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.667314 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.667649 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.667916 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.668241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.668596 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-10-iscsi {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.668928 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.669246 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.669594 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.670007 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.670254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.670587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.670901 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.671407 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.671859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.672198 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.672535 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.672867 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.673188 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.674082 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.674082 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.674300 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.674485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.674813 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.675219 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-10-iscsi {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.675544 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.675878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.676204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.676629 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.676956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.677283 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.677636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.678198 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.678518 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.679200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.679579 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.679954 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.680308 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.680627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.680927 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.681251 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.681624 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.681936 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.682257 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.682537 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.682852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.683178 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.683513 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.683859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.684118 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.684376 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.684721 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.685054 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.685369 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.685712 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.686049 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.686365 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.686680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.687014 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.687328 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.687641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.687986 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.688313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.688643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.688957 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.689307 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.689742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.690003 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.690338 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.690690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.691016 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.691353 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.691681 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.692014 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.692352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.692669 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.692983 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.693310 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.693707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.694019 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.694316 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.694820 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.695261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.695596 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.695916 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.696256 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.696575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.696887 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.697214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.697565 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.697886 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.698200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.698531 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.698847 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.699161 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.699475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.699808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.700143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.700464 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.700802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.701222 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.701430 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.701779 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.702125 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.702441 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.702756 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.703112 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.703422 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.703733 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.704059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.704393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.704707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.705032 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.705358 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.705854 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.706181 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.706522 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.706838 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.707152 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.707488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.707801 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.708114 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.708429 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.708761 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.709069 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.709385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.709757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.710596 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.710960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.711295 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.711627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.711975 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.712320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.712695 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.713017 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.713362 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.713800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.714072 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.714390 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.714729 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.715087 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.715423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.715756 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.716009 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.716332 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.716656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.717014 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.717336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.717688 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.718036 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.718357 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.718679 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.719034 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.719366 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.719682 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.720033 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.720404 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.720725 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.721060 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.721416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.721764 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.722083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.722429 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.722760 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.723100 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.723446 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.723770 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.724089 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.724429 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.724750 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.725069 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.725389 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.726493 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.726742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.726969 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.727316 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.727644 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.727967 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.728306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.728628 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.728942 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.729256 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.729766 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.729941 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.730234 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.730585 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.730923 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.731236 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.731600 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.731917 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.732241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.732560 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.732898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.733212 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.733557 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.733896 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.734211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.734545 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.734882 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.735198 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.735529 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.735844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.736179 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.736505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.736826 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.737168 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.737488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.737834 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.738186 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.738510 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.738830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.739177 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.739529 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.739904 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.740168 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.740524 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.740860 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.741196 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.741641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.741872 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.742189 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.742499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.742837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.743148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.743459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.743769 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.744175 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.744415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.744744 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.745059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.745394 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.745733 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.746046 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.746418 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.746734 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.747076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.747573 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.747771 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.748088 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.748426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.748754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.749071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.749389 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.749770 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.750182 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.750406 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.750745 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.751076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.751392 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.751753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.752057 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.752390 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.752706 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.753053 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.753401 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.753767 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.754126 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.754443 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.754763 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.755119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.755409 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.755716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.756031 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.756367 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.756813 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.757157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.757507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.757849 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.758180 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.758498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.758824 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.759157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.759481 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.759820 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.760222 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.760520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.760839 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.761191 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.761559 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.761887 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.762213 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.762551 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.763370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.763370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.763724 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.763975 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.764153 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.764471 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.764820 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.765134 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.765579 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.765836 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.766212 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.766548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.766985 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.767258 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.767701 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.768021 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.768412 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.768745 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.769121 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.769499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.769873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.770190 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.770643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.770891 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.771228 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.771546 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.771878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.772205 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.773052 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.773647 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.774072 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.774410 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.774738 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.775059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.775382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.775727 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.776048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.776369 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.776702 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.777118 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.777357 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.777706 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.778020 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.778361 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.778688 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.779317 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.779637 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.779961 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.780306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.780639 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.780965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.781340 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.781672 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.782021 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.782336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.782677 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.782990 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.783303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.783641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.783953 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.784295 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.784567 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.784894 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.785204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.785527 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.785886 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.786198 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.786519 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.786852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.787240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.787766 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.788142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.788958 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.789267 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.789602 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.789915 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.790268 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.790605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.790997 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.791283 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.791656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.791974 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.792419 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.792615 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.792941 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.793254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.793592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.793934 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.794352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.794564 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.794903 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.795224 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.795544 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.795860 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.796191 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.796501 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.796812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.797157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.797566 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.797904 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.798131 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.798451 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.798767 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.799077 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.799415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.799727 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.800048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.800381 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.800692 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.801003 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.801336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.801683 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.801998 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.802338 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.802669 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.802978 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.803289 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.803660 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.804138 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.804485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.804868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.805206 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.805596 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.805891 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.806211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.806550 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.806867 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.807201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.807574 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.807827 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.808139 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.808487 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.808807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.809119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.809481 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.809837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.810150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.810463 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.810774 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.811144 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.811442 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.811809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.812129 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.812454 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.812811 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.813129 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.813449 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.813800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.814136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.814460 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.814780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.815160 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.815426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.815740 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.816071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.816414 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.816735 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.817065 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.817396 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.817779 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.818197 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.818434 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.818755 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.819093 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.819960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.820507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.820950 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.821319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.821634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.821969 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.822290 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.822613 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.822956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.823275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.823591 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.823930 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.824270 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.824586 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.824904 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.825291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.825568 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.825889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.826336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.826677 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.827001 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.827316 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.827635 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.828010 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.828323 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.828607 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.828943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.829373 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.829719 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.830059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.830379 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.830692 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.831004 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.831344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.831779 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.832027 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.832295 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.832636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.832792 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 11:01:59.833383 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.833566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 11:01:59.833718 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.833872 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 11:01:59.834024 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.834176 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 11:01:59.834419 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.834567 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 11:01:59.834718 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.834908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.838613 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.838807 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.838978 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.839131 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.839277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.839422 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.839574 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.839574 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.839867 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.840025 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.840025 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.840316 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.840473 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.840627 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.840770 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.840920 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.841071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.841215 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.841367 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.841548 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.841840 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.842107 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.842342 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.842498 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-10-iscsi {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.842659 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.842804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.842955 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.843109 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.843252 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.843483 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.843646 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.843798 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.843948 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.844092 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.845724 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.845906 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.845906 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.846190 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.846190 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.846478 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.846642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.846749 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.846844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.847002 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.847096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.847181 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.847276 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.847362 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.847444 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.847533 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.847625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.847791 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.848026 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.848175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.848821 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.848975 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.848975 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.849254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.849419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.849592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.849592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.849878 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-10-iscsi {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.850067 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.850229 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.850381 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.850584 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.850818 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.850984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.850984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.850984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.850984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.850984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.851687 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.851855 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.852135 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.852483 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.852678 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.852840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.852991 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.853148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.853307 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.853485 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.853774 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.853949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.854100 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.854251 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.854409 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.854559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.854744 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.854912 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.855072 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.855238 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.855503 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.855503 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.855878 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.856035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.856744 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.856744 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.857067 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.857226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.857377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.857553 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.857711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.857877 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.858044 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.858270 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.858430 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.858835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.858835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.859165 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.859323 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.859475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.859624 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.859774 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.859932 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.860089 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.860250 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.860409 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.860560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.860709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.860876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.861027 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.861176 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.861323 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.861488 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.861685 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.861847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.862205 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.862364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.862611 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.862943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.863108 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.863259 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.863420 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.863655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.863954 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.864119 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.864285 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.864436 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.864592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.864780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.864936 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.865094 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.865257 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.865407 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.865683 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.865861 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.866012 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.866231 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.866431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.866636 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.866636 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.866986 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.866986 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.867279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.867279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.867571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.867729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.867905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.868056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.868219 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.868471 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.868634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.869040 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.869204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.869365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.869534 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.869715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.869875 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.870034 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.870191 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.870367 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.870518 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.870667 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.870822 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.870981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.870981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.871273 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.871424 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.871572 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.871721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.871869 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.872028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.872186 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.872355 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.872505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.872505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.872505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.872505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.872505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.872505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.872505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.872505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.874184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.874413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.874575 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.874738 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.874913 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.875112 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.875270 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.875438 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.875590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.875871 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.876037 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.876197 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.876348 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.876506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.876659 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.876808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.876978 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.876978 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.877282 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.877441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.877624 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.877787 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.877946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.878109 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.878268 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.878419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.878657 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.878820 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.879200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.879374 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.879533 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.879684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.879833 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.879991 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.880150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.880347 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.880508 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.880659 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.880816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.880973 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.881131 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.881299 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.881457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.881632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.882376 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.882543 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.882693 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.882927 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.883100 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.883441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.883608 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.883760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.883909 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.884172 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.884459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.884645 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.884645 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.884943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.885093 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.885257 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.885420 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.885658 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.885832 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.886058 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.886220 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.886371 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.886532 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.886809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.886987 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.886987 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.887283 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.887441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.887599 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.887764 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.887921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.888079 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.888229 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.888386 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:01:59.888556 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.888794 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.888951 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.889337 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.890077 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.890269 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.890435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.890588 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.890746 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.890900 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.890900 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.891203 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.891367 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.891538 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.891697 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.891847 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.892004 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.892160 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.892329 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.892602 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.892787 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.892966 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.893199 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.893384 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.893668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.893826 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.893996 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.894339 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.894498 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.894498 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.894806 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.894958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.895108 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.895268 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.895427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.895590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.895742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.895891 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.896071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.896310 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.896472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.896632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.896789 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.896948 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.897119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.897406 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.897625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.897787 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.897938 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.898096 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.898256 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.899005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.899194 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.899635 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.899794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.899960 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.900118 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.900271 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.901020 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.901178 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.901340 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.901494 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.901749 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.901910 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.902061 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.902218 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.902380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.902772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.902976 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.903138 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.903445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.903613 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.903926 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.904093 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.904263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.904654 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.904812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.904972 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.905122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.905291 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.905444 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.905750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.905904 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.906067 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.906218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.906501 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.906661 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.906819 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.906988 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.907153 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.907310 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.907461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.907611 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.907768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.907918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.907918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.908220 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.908370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.908526 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.908684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.908841 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.908841 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.909262 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.909417 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.909941 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.910100 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.910264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.910425 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.910585 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.910585 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.910888 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.911046 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.911210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.911372 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.911530 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.911680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.911830 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.911979 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.912141 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.912298 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.912696 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.912696 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.913025 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.913184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.913343 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.913343 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.913768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.913937 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.914208 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.914884 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.914884 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.915182 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.915342 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.915342 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.915799 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.915968 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.915968 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.916302 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.916532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.916705 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.916804 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.916804 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.916969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.917053 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.917137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.917220 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.917382 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.917469 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.917469 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.917652 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.917744 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.917835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.917927 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918012 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918102 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918542 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918708 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918882 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.918973 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.919058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.919149 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.919255 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.919341 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.919437 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.919522 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.919605 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.919713 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920057 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920153 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920246 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920338 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920422 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920514 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920598 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920598 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920765 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920855 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.920945 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921036 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921396 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921483 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921612 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921612 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921779 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921871 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.921956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922046 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922130 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922379 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922464 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922547 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922629 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922802 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922885 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.922968 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923056 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923147 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923238 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923331 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923500 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923862 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.923951 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.924041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.924133 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.924389 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.924495 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.924582 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.924582 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.924762 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.924873 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.924961 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925045 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925130 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925217 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925396 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925493 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925594 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925688 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925781 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.925964 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.926061 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.926153 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.926499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.926604 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.926749 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.926843 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.926929 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927012 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927104 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927188 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927284 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927550 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927716 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927892 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.927975 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.928057 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.928139 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.928230 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.928334 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.928428 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.928511 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.928622 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.928743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.928854 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.928948 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.929039 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.929129 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.929214 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.929296 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.929388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.929479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.929587 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.929660 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.929762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.929849 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.930230 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.930332 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.930417 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.930508 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.930601 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.930686 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.930850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.930944 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931126 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931293 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931293 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931549 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931722 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931817 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931908 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.931992 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932074 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932156 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932522 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932612 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932696 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932874 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.932965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.933059 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.933059 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.933211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.933310 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.933396 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.933478 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.933610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.933696 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.933778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.933944 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.934039 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.934249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.934362 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.934557 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.934684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.934865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.935060 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.935190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.935342 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.935500 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.935683 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.935823 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.936004 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.936146 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.936339 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.936484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.936656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.936749 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.936978 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.937072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.937302 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.937439 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.937642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.937750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.937966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.938143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.938257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.938376 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.938597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.938716 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.938917 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.939048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.939226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.939354 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.939544 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.939665 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.939865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.939991 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.940300 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.940445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.940559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.940676 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.940801 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.940913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.941085 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.941215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.941408 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.941559 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.941759 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.941987 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.942301 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.942434 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.942649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.942771 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.942952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 11:01:59.943072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.943293 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.943608 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.944061 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.944968 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.945473 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.946742 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.946742 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.946742 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.947150 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.947596 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.947970 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.948299 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.948622 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.948944 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.949270 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.949632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.949964 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.950303 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.950615 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.950926 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.951233 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.951538 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.951850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.952154 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.952458 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.952761 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.953071 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.953382 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.953721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.954027 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.954333 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.954653 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.954957 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.955275 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.955580 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.955912 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.956221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.956529 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.956835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.957138 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.957483 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.957816 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.958159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.958490 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.958832 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.959138 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.959443 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.959770 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.960676 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.960983 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.961287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.961626 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.961937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.962245 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.962562 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.962871 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.963183 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.963499 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.963805 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.964111 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.964416 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.964732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.965044 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.965350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.965679 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.965993 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.966302 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.966606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.966916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.967220 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.967535 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.967839 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.968140 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.968441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.968750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.969058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.969359 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.969715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.970039 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.970333 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.970634 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.970945 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.971247 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.971551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.971859 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.972184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.972519 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.972808 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.973119 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.973431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.973763 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.974070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.974375 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.974678 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.974981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.975290 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.975628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.975930 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.976252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.976558 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.976862 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.977173 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.977472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.977866 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.978175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.978536 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.978844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.979160 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.979481 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.979794 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.980106 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.980422 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.980728 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.981048 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.981356 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.981696 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.982004 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.982387 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.983013 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.984724 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.984724 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.984724 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.984724 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.985051 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.985207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.985739 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.986208 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.986524 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.986841 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.987153 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.987467 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.987782 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.988098 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.988437 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.988723 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.989033 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.989346 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.989731 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.990054 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.990389 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.990702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.991007 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.992019 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.992019 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.992279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.992440 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.992889 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.993210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.993536 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.993857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.994174 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.994487 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.994807 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.995125 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.995430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.995857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.996171 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.996482 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.996793 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.997098 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.997402 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.997739 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.998067 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.998368 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.998674 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.998978 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.999301 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.999610 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:01:59.999931 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.000364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.000681 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.000989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.001408 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.001753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.002142 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.002395 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.002718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.003052 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.003358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.003676 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.003985 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.004311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.004637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.004948 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.005264 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.005590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.005918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.006240 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.006554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.007416 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.007938 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.008175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.008655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.008984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.009313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.009644 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.009954 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.010268 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.010578 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.010889 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.011214 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.011526 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.011840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.012211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.012457 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.012764 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.013069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.013393 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.013733 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.014061 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.014381 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.014705 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.015030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.015337 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.015661 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.015971 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.016277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.016585 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.016890 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.017238 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.017565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.017890 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.018221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.018558 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.018869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.019207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.019535 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.019856 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.020176 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.020499 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.020804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.021109 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.021419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.021749 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.022056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.022382 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.023338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.023708 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.023994 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.024253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.024579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.024885 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.025208 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.025565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.025847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.026157 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.026461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.026808 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.027113 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.027443 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.027755 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.028241 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.028241 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.028836 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.028992 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.029302 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.029639 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.029958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.030273 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.030583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.030899 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.031218 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.031536 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.032114 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.032452 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.032758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.033077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.033394 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.033743 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.034061 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.034377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.034690 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.035004 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.035319 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.035650 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.035973 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.036300 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.036642 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.036963 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.037278 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.037937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.038311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.038675 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.039000 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.039287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.039602 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.039919 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.040234 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.040547 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.040858 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.041173 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.041486 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.041893 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.042133 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.042446 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.042764 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.043086 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.043431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.043820 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.044062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.044376 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.044690 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.045226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.045557 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.045896 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.046224 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.046548 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.046870 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.047187 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.047515 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.047823 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.048129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.048440 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.048751 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.049056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.049375 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.049710 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.050016 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.050339 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.050650 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.051182 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.051531 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.051845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.052171 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.052495 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.052810 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.053128 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.053432 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.053937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.054272 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.054582 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.054897 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.055204 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.055510 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.055824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.056134 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.056441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.056754 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.057059 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.057384 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.057713 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.058020 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.058324 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.058636 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.058940 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.059245 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.059551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.059855 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.060167 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.060470 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.060779 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.061086 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.061396 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.061727 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.062036 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.062340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.062662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.062966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.063330 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.063645 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.063955 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.064286 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.064597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.064907 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.065257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.065597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.066136 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.066473 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.066796 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.067131 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.067464 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.067773 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.068081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.068389 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.068714 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.069027 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.069869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.070185 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.070497 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.070807 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.071119 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.071429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.071739 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.072048 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.072357 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.072666 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.072976 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.073284 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.073612 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.073934 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.074279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.074600 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.074919 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.075236 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.075554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.075867 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.076178 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.076491 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.076802 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.077118 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.077446 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.077785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.078092 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.078519 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.078834 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.079153 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.079474 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.079782 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.080104 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.080426 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.080737 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.081059 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.081370 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.081723 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.082064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.082394 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.082720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.083028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.083332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.083637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.083950 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.084269 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.084579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.084976 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.085801 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.086120 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.086425 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.086728 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.087037 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.087340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.087648 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.087952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.088262 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.088564 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.088867 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.089175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.089475 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.089807 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.090138 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.090417 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.090721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.091024 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.091330 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.091655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.092083 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.092304 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.092630 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.092939 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.093258 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.093586 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.093916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.094234 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.094549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.094856 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.095186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.095497 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.095727 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO dbcounter [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Registered counter for database nova_api Aug 18 11:02:00.095908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.096099 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.096404 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.096712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.097018 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.097341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.097704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.098008 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.098331 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.098647 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.098967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.099287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.099590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.099914 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.100222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.100556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.100870 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.101179 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.101487 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.101825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.102136 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.102447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.102763 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.103079 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.103409 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.103738 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.104049 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.104377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.104700 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.105047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.105361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.105751 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.106083 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.106401 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.106712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.107019 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:02:00.107264 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 11:02:00.116421 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_db.sqlalchemy.engines [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:02:00.124069 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writer thread running {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:02:00.186627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.context [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6dc9e351-1b25-4e87-b441-33938908aec2(cell1) {{(pid=120801) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 11:02:00.190851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:02:00.191337 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:02:00.193000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:02:00.193851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:02:00.194918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:02:00.197443 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:02:00.199604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO dbcounter [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Registered counter for database nova_cell0 Aug 18 11:02:00.203956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO dbcounter [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Registered counter for database nova_cell1 Aug 18 11:02:00.213326 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_db.sqlalchemy.engines [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:02:00.214551 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_db.sqlalchemy.engines [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:02:00.220428 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writer thread running {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:02:00.259322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO dbcounter [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Registered counter for database nova_api Aug 18 11:02:00.279232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_db.sqlalchemy.engines [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:02:00.285731 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writer thread running {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:02:00.342843 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.context [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6dc9e351-1b25-4e87-b441-33938908aec2(cell1) {{(pid=120800) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 11:02:00.346884 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:02:00.347504 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:02:00.348966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:02:00.349753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:02:00.350199 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:02:00.352210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:02:00.354270 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO dbcounter [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Registered counter for database nova_cell0 Aug 18 11:02:00.358354 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO dbcounter [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Registered counter for database nova_cell1 Aug 18 11:02:00.362334 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writer thread running {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:02:00.368181 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_db.sqlalchemy.engines [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:02:00.370140 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_db.sqlalchemy.engines [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:02:00.374490 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO dbcounter [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Registered counter for database nova_cell0 Aug 18 11:02:00.375821 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writer thread running {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:02:00.381280 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_db.sqlalchemy.engines [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:02:00.382555 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writer thread running {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:02:00.387009 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writer thread running {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:02:00.534012 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO dbcounter [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Registered counter for database nova_cell0 Aug 18 11:02:00.544819 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_db.sqlalchemy.engines [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:02:00.550448 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writer thread running {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:02:00.717431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: WARNING keystonemiddleware.auth_token [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:02:00.724644 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: WARNING keystonemiddleware.auth_token [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:02:00.888081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: WARNING keystonemiddleware.auth_token [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:02:00.895477 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: WARNING keystonemiddleware.auth_token [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:02:01.075228 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: WARNING keystonemiddleware.auth_token [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:02:01.081844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: WARNING keystonemiddleware.auth_token [None req-c615ee5d-3d94-434d-9e48-aa02d90f84b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:02:01.089279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557eab7709c0 pid: 120801 (default app) Aug 18 11:02:01.255551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: WARNING keystonemiddleware.auth_token [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:02:01.262417 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: WARNING keystonemiddleware.auth_token [None req-fd883818-35d4-4597-b4c1-6abe6334c8f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:02:01.268655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557eab7709c0 pid: 120800 (default app) Aug 18 11:02:37.317382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.318971 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.322282 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.323461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.718563 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=3 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.720620 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=3 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.725859 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=3 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:37.728576 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=3 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:02:38.713080 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6c81e227-243e-41d8-97ce-3a2eba9f27d3 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] Action: 'create', calling method: .version_select at 0x7f7ecab1a280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-299510171", "metadata": {"Type": "work"}}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:38.945048 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4c91809c-5af8-481a-bb38-08b635eba8b9 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Action: 'create', calling method: .version_select at 0x7f7ecab1d280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2096549177"}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:40.953203 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6c81e227-243e-41d8-97ce-3a2eba9f27d3 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.642156 Aug 18 11:02:40.953881 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Aug 18 11:02:37 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3645 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 11:02:40.970894 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4101effd-ee59-4fdf-b99e-e60d8ac9f0fc tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] Calling method '.version_select at 0x7f7eca97c160>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:41.039046 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4c91809c-5af8-481a-bb38-08b635eba8b9 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.333655 Aug 18 11:02:41.041470 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 1/2] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Aug 18 11:02:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3339 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 11:02:41.059742 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c551d8de-1636-4641-97aa-483ea8614368 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca97b160>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:41.089472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4101effd-ee59-4fdf-b99e-e60d8ac9f0fc tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297" status: 200 len: 352 microversion: 2.1 time: 0.124759 Aug 18 11:02:41.090386 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:40 2022] GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:02:41.217720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c551d8de-1636-4641-97aa-483ea8614368 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236" status: 200 len: 345 microversion: 2.1 time: 0.165498 Aug 18 11:02:41.218827 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:41 2022] GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236 => generated 345 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:02:42.104428 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2307ddc1-c564-4be2-99d0-3ebb4f8937b5 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] Calling method '.version_select at 0x7f7eca97c820>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:42.199656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2307ddc1-c564-4be2-99d0-3ebb4f8937b5 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297" status: 200 len: 353 microversion: 2.1 time: 0.099548 Aug 18 11:02:42.201055 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:42 2022] GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:42.214227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bf242e15-884c-4c3c-ba07-02313726bace tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] Calling method '.version_select at 0x7f7eca97b8b0>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:42.248652 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-46a71219-e4e8-483a-a7b0-e29f52f97aeb tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca97cee0>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:42.363732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bf242e15-884c-4c3c-ba07-02313726bace tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297" status: 200 len: 353 microversion: 2.1 time: 0.153250 Aug 18 11:02:42.364455 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:42 2022] GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:42.379250 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fe069ef7-ac12-4cae-89bb-a609ca0f1224 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] Calling method '.version_select at 0x7f7eca984040>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:42.562473 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fe069ef7-ac12-4cae-89bb-a609ca0f1224 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297" status: 202 len: 0 microversion: 2.1 time: 0.186868 Aug 18 11:02:42.564934 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Aug 18 11:02:42 2022] DELETE /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:02:42.575000 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4330cdb6-2623-4eca-9a19-8e08fed46df0 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] Calling method '.version_select at 0x7f7eca97bb80>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:42.694198 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-46a71219-e4e8-483a-a7b0-e29f52f97aeb tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236" status: 200 len: 346 microversion: 2.1 time: 0.465369 Aug 18 11:02:42.702439 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:42 2022] GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236 => generated 346 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:42.707543 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ea4a6deb-deef-4bc6-aeb3-afe0cc1c9e1c tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Action: 'create', calling method: .version_select at 0x7f7eca97cb80>, body: {"snapshot": {"volume_id": "a27514ef-a863-4622-9e76-c308abc5c236", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1932457369"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:42.720926 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4330cdb6-2623-4eca-9a19-8e08fed46df0 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297" status: 200 len: 352 microversion: 2.1 time: 0.151571 Aug 18 11:02:42.721491 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:42 2022] GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297 => generated 352 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:43.047278 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ea4a6deb-deef-4bc6-aeb3-afe0cc1c9e1c tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.343384 Aug 18 11:02:43.054312 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 5/10] 10.222.0.15 () {60 vars in 1162 bytes} [Thu Aug 18 11:02:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:43.059967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-cc1e279c-1451-4b83-ae78-05671aa6cc64 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca97b430>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:43.222019 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-cc1e279c-1451-4b83-ae78-05671aa6cc64 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876" status: 200 len: 287 microversion: 2.1 time: 0.166272 Aug 18 11:02:43.224720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Aug 18 11:02:43 2022] GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876 => generated 287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:43.236273 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5c834acd-b012-4585-a3f5-abe7e81cc31d tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca97d280>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:43.317300 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5c834acd-b012-4585-a3f5-abe7e81cc31d tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.085747 Aug 18 11:02:43.318246 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1140 bytes} [Thu Aug 18 11:02:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:43.332407 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9f0a7f5d-e2cf-464c-ba65-5a785516b663 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca984310>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:43.390208 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9f0a7f5d-e2cf-464c-ba65-5a785516b663 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876" status: 200 len: 287 microversion: 2.1 time: 0.062723 Aug 18 11:02:43.390999 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Aug 18 11:02:43 2022] GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:43.739623 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5b4a6040-1243-400b-8efa-c77aa0060563 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] Calling method '.version_select at 0x7f7eca97dd30>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:43.824101 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-5b4a6040-1243-400b-8efa-c77aa0060563 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] HTTP exception thrown: Volume 1a50f527-5f77-4494-a617-2a7a2f832297 could not be found. Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5b4a6040-1243-400b-8efa-c77aa0060563 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] Request method failure captured: Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297 HTTP/1.1 Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxNURh3_FM1xrFhcZOjaF4_eEx630WZA1K8RdsN0R-oFyX7MA64WHLtq95qY0RWPVG8Dz481ccwceNp3fseCW1xJ6eEo14jkUBG9pFnDq24YGOc8Pp0Y4cUP5utzdeaGCuEwG4TBT9FAz_HyssHa2dd6XLRBSm1D_z5AHGsolipdC4 Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 523cb8f17fc9468d86944717135714f4 Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-VolumesGetTestJSON-1204819821 Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:02:43.831147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_523cb8f17fc9468d86944717135714f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/523cb8f17fc9468d86944717135714f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/523cb8f17fc9468d86944717135714f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/523cb8f17fc9468d86944717135714f4"}]}] Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-VolumesGetTestJSON-1204819821 Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 523cb8f17fc9468d86944717135714f4 Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-VolumesGetTestJSON-1204819821 Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-VolumesGetTestJSON-1204819821-project Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 4153b369951f48e1afc6aff02a75f9c2 Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-VolumesGetTestJSON-1204819821-project Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Volume 1a50f527-5f77-4494-a617-2a7a2f832297 could not be found. Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '1a50f527-5f77-4494-a617-2a7a2f832297'} Aug 18 11:02:43.832415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a50f527-5f77-4494-a617-2a7a2f832297 could not be found. (HTTP 404) (Request-ID: req-4fa5f0df-28a2-420d-85d1-0a229b4b1c76) Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:43.833269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:02:43.835377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a50f527-5f77-4494-a617-2a7a2f832297 could not be found. Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 11:02:43.836408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a50f527-5f77-4494-a617-2a7a2f832297 could not be found. Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a50f527-5f77-4494-a617-2a7a2f832297 could not be found. Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5b4a6040-1243-400b-8efa-c77aa0060563 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] Returning 404 to user: Volume 1a50f527-5f77-4494-a617-2a7a2f832297 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:43.837507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5b4a6040-1243-400b-8efa-c77aa0060563 tempest-VolumesGetTestJSON-1204819821 tempest-VolumesGetTestJSON-1204819821-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297" status: 404 len: 109 microversion: 2.1 time: 0.099752 Aug 18 11:02:43.839256 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 7/14] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:43 2022] GET /compute/v2.1/os-volumes/1a50f527-5f77-4494-a617-2a7a2f832297 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:02:44.404974 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-66b09171-cd29-4adb-baf8-f8300b8af6a9 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca97b160>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:44.474558 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-66b09171-cd29-4adb-baf8-f8300b8af6a9 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876" status: 200 len: 287 microversion: 2.1 time: 0.074687 Aug 18 11:02:44.476544 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Aug 18 11:02:44 2022] GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:45.493317 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c26cca5d-04e4-4761-90c6-c548d3926eab tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7ecb359700>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:45.569213 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c26cca5d-04e4-4761-90c6-c548d3926eab tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876" status: 200 len: 287 microversion: 2.1 time: 0.083131 Aug 18 11:02:45.577645 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Aug 18 11:02:45 2022] GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:46.589939 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a7014140-99cc-4791-b608-4a4f1f59001c tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca97b8b0>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:46.642107 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a7014140-99cc-4791-b608-4a4f1f59001c tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876" status: 200 len: 288 microversion: 2.1 time: 0.061556 Aug 18 11:02:46.642985 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 9/17] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Aug 18 11:02:46 2022] GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876 => generated 288 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:46.655755 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-37ea17e0-d3f1-45ec-a61f-b2a72d04b56b tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca97da60>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:46.798002 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-37ea17e0-d3f1-45ec-a61f-b2a72d04b56b tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876" status: 202 len: 0 microversion: 2.1 time: 0.145036 Aug 18 11:02:46.798803 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 9/18] 10.222.0.15 () {58 vars in 1254 bytes} [Thu Aug 18 11:02:46 2022] DELETE /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:02:46.810248 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-95973ae9-676c-44e0-8fea-6a3c75e0b785 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca984550>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:46.875467 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-95973ae9-676c-44e0-8fea-6a3c75e0b785 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876" status: 200 len: 287 microversion: 2.1 time: 0.071167 Aug 18 11:02:46.880864 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 10/19] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Aug 18 11:02:46 2022] GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:47.889900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b7cadee7-09e9-418b-b20d-701f10442ac6 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca8f2310>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:47.943463 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-b7cadee7-09e9-418b-b20d-701f10442ac6 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] HTTP exception thrown: Snapshot 61958a4a-767d-46f3-9fd9-1b5af4698876 could not be found. Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b7cadee7-09e9-418b-b20d-701f10442ac6 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Request method failure captured: Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876 HTTP/1.1 Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxNxYS28hOFx0LP3_rjE0zM7fFGOM-IXKgzGSLp6Uah7H-53UcuAl146-IqyWBae0vYXJnkOo0c5-gNV4TShllOBvjjDNs5mW52aJFLieIvFyZP8fcRPGbc58gdbAAejCa10ZzLYM6RaxfizRyug22bKh6mmsYzuHvJ2s9t18J7uII Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 577132f31a0d4c609b927067d45f3105 Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:02:47.946482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_577132f31a0d4c609b927067d45f3105", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/577132f31a0d4c609b927067d45f3105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/577132f31a0d4c609b927067d45f3105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/577132f31a0d4c609b927067d45f3105"}]}] Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 577132f31a0d4c609b927067d45f3105 Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-VolumesSnapshotsTestJSON-195972273-project Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 8980e83b77e749339c551bbe54fc40bf Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195972273-project Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Snapshot 61958a4a-767d-46f3-9fd9-1b5af4698876 could not be found. Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '61958a4a-767d-46f3-9fd9-1b5af4698876'} Aug 18 11:02:47.947814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 61958a4a-767d-46f3-9fd9-1b5af4698876 could not be found. (HTTP 404) (Request-ID: req-aa3cedd6-059c-486a-a092-7e7619ed40a2) Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:47.948631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:02:47.949488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 61958a4a-767d-46f3-9fd9-1b5af4698876 could not be found. Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 18 11:02:47.950385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 61958a4a-767d-46f3-9fd9-1b5af4698876 could not be found. Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 61958a4a-767d-46f3-9fd9-1b5af4698876 could not be found. Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b7cadee7-09e9-418b-b20d-701f10442ac6 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Returning 404 to user: Snapshot 61958a4a-767d-46f3-9fd9-1b5af4698876 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b7cadee7-09e9-418b-b20d-701f10442ac6 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876" status: 404 len: 111 microversion: 2.1 time: 0.062485 Aug 18 11:02:47.951291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 10/20] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Aug 18 11:02:47 2022] GET /compute/v2.1/os-snapshots/61958a4a-767d-46f3-9fd9-1b5af4698876 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:02:47.957487 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f3ea61dd-27df-4318-813a-73ca80e641a4 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca984820>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:48.121560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f3ea61dd-27df-4318-813a-73ca80e641a4 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236" status: 202 len: 0 microversion: 2.1 time: 0.168302 Aug 18 11:02:48.125508 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 11/21] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Aug 18 11:02:47 2022] DELETE /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:02:48.135492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-99e684e3-7d31-41e6-9112-20b675236aaa tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7ecb359670>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:48.284213 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-99e684e3-7d31-41e6-9112-20b675236aaa tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236" status: 200 len: 345 microversion: 2.1 time: 0.157261 Aug 18 11:02:48.286529 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 11/22] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:48 2022] GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236 => generated 345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:49.303976 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-49508ed0-92d8-4d37-ac7d-54806acdd471 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca97cb80>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:49.382019 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-49508ed0-92d8-4d37-ac7d-54806acdd471 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] HTTP exception thrown: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-49508ed0-92d8-4d37-ac7d-54806acdd471 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Request method failure captured: Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236 HTTP/1.1 Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxNxYS28hOFx0LP3_rjE0zM7fFGOM-IXKgzGSLp6Uah7H-53UcuAl146-IqyWBae0vYXJnkOo0c5-gNV4TShllOBvjjDNs5mW52aJFLieIvFyZP8fcRPGbc58gdbAAejCa10ZzLYM6RaxfizRyug22bKh6mmsYzuHvJ2s9t18J7uII Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 577132f31a0d4c609b927067d45f3105 Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:02:49.384403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_577132f31a0d4c609b927067d45f3105", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/577132f31a0d4c609b927067d45f3105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/577132f31a0d4c609b927067d45f3105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/577132f31a0d4c609b927067d45f3105"}]}] Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 577132f31a0d4c609b927067d45f3105 Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-VolumesSnapshotsTestJSON-195972273-project Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 8980e83b77e749339c551bbe54fc40bf Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195972273-project Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'a27514ef-a863-4622-9e76-c308abc5c236'} Aug 18 11:02:49.385699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. (HTTP 404) (Request-ID: req-88c51570-6ebf-49af-94c7-fd5d2c3899dc) Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.386435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:02:49.387498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 11:02:49.389352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.392166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-49508ed0-92d8-4d37-ac7d-54806acdd471 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Returning 404 to user: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:49.393352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-49508ed0-92d8-4d37-ac7d-54806acdd471 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236" status: 404 len: 109 microversion: 2.1 time: 0.095895 Aug 18 11:02:49.394897 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:49 2022] GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:02:49.429372 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-780372a8-761b-4d9e-8166-fa277d9bc7f6 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca8f2550>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:49.497083 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-de5af520-f40f-48c2-a4ee-c66045b13ee5 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Action: 'create', calling method: .version_select at 0x7f7eca97bc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-580713476", "metadata": {"Type": "work"}}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-de5af520-f40f-48c2-a4ee-c66045b13ee5 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Request method failure captured: Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 121 Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxYEGbeWA784bR2h1ukAgL8pY5xzSTfhs-MRigGRmosQfv6qgIwERKmWVffSGzgDdvBzMaNjqT2OsqB4nDwu0NJMotAmburxuhtVIdrsOrY4lb97AVmdFZTbN6BOIzjHvRl04jwx7gdAj2i47El8llZN8N2jLYaM4hlQ1n8bJe7J9E Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:02:49.509430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_83c296e31a604c23b028c480c90270b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/83c296e31a604c23b028c480c90270b4"}]}] Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 7cedc379cbe243bebeafa336bd078da7 Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-580713476", "metadata": {"Type": "work"}}} Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: Aug 18 11:02:49.510702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-580713476', 'metadata': {'Type': 'work'}}}} Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi '#$%' Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:49.511429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:02:49.512556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:02:49.513457 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 11:02:49.513457 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.518701 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-de5af520-f40f-48c2-a4ee-c66045b13ee5 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:49.524372 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-de5af520-f40f-48c2-a4ee-c66045b13ee5 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.387372 Aug 18 11:02:49.525263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-780372a8-761b-4d9e-8166-fa277d9bc7f6 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] HTTP exception thrown: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.526577 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 12/24] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Aug 18 11:02:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 393 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-780372a8-761b-4d9e-8166-fa277d9bc7f6 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Request method failure captured: Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: DELETE /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236 HTTP/1.1 Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxNxYS28hOFx0LP3_rjE0zM7fFGOM-IXKgzGSLp6Uah7H-53UcuAl146-IqyWBae0vYXJnkOo0c5-gNV4TShllOBvjjDNs5mW52aJFLieIvFyZP8fcRPGbc58gdbAAejCa10ZzLYM6RaxfizRyug22bKh6mmsYzuHvJ2s9t18J7uII Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 577132f31a0d4c609b927067d45f3105 Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:02:49.529202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_577132f31a0d4c609b927067d45f3105", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/577132f31a0d4c609b927067d45f3105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/577132f31a0d4c609b927067d45f3105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/577132f31a0d4c609b927067d45f3105"}]}] Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 577132f31a0d4c609b927067d45f3105 Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-VolumesSnapshotsTestJSON-195972273-project Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 8980e83b77e749339c551bbe54fc40bf Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195972273-project Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'a27514ef-a863-4622-9e76-c308abc5c236'} Aug 18 11:02:49.530399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. (HTTP 404) (Request-ID: req-7bca4a28-74ca-4144-87c5-923be160f12b) Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.531037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 11:02:49.532076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 11:02:49.533083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-780372a8-761b-4d9e-8166-fa277d9bc7f6 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Returning 404 to user: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:49.534400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-780372a8-761b-4d9e-8166-fa277d9bc7f6 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236" status: 404 len: 109 microversion: 2.1 time: 0.112291 Aug 18 11:02:49.535660 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Aug 18 11:02:49 2022] DELETE /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:02:49.543475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-353f99a6-d257-4e13-bb3f-6bf831f441d3 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Calling method '.version_select at 0x7f7eca97dca0>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:49.556639 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-528a4f37-82b9-453a-b9d4-917ade6e8025 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Action: 'create', calling method: .version_select at 0x7f7eca9845e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2147219962", "metadata": {"Type": "work"}}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-528a4f37-82b9-453a-b9d4-917ade6e8025 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Request method failure captured: Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 120 Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxYEGbeWA784bR2h1ukAgL8pY5xzSTfhs-MRigGRmosQfv6qgIwERKmWVffSGzgDdvBzMaNjqT2OsqB4nDwu0NJMotAmburxuhtVIdrsOrY4lb97AVmdFZTbN6BOIzjHvRl04jwx7gdAj2i47El8llZN8N2jLYaM4hlQ1n8bJe7J9E Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:02:49.566568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_83c296e31a604c23b028c480c90270b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/83c296e31a604c23b028c480c90270b4"}]}] Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 7cedc379cbe243bebeafa336bd078da7 Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2147219962", "metadata": {"Type": "work"}}} Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: Aug 18 11:02:49.569943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2147219962', 'metadata': {'Type': 'work'}}}} Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi '0' Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:49.570649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:02:49.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:02:49.572552 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 11:02:49.572552 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.574632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-528a4f37-82b9-453a-b9d4-917ade6e8025 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:49.580946 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-528a4f37-82b9-453a-b9d4-917ade6e8025 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.044414 Aug 18 11:02:49.583292 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 13/26] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Aug 18 11:02:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:02:49.598323 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-11e112c1-1ec2-432f-a633-779feb7f517a tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Action: 'create', calling method: .version_select at 0x7f7eca97b940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-58432894", "metadata": {"Type": "work"}}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-11e112c1-1ec2-432f-a633-779feb7f517a tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Request method failure captured: Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 117 Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxYEGbeWA784bR2h1ukAgL8pY5xzSTfhs-MRigGRmosQfv6qgIwERKmWVffSGzgDdvBzMaNjqT2OsqB4nDwu0NJMotAmburxuhtVIdrsOrY4lb97AVmdFZTbN6BOIzjHvRl04jwx7gdAj2i47El8llZN8N2jLYaM4hlQ1n8bJe7J9E Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:02:49.612005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_83c296e31a604c23b028c480c90270b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/83c296e31a604c23b028c480c90270b4"}]}] Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 7cedc379cbe243bebeafa336bd078da7 Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-58432894", "metadata": {"Type": "work"}}} Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: Aug 18 11:02:49.613322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-58432894', 'metadata': {'Type': 'work'}}}} Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi '' Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:49.614129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:02:49.615361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:02:49.616569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 11:02:49.616569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.617997 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-11e112c1-1ec2-432f-a633-779feb7f517a tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:49.621213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-11e112c1-1ec2-432f-a633-779feb7f517a tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026781 Aug 18 11:02:49.624775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 14/27] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Aug 18 11:02:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 11:02:49.640223 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2658d88b-4196-48e3-959b-fc0fc6771e18 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Calling method '.version_select at 0x7f7eca94a940>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:49.655374 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-353f99a6-d257-4e13-bb3f-6bf831f441d3 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] HTTP exception thrown: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-353f99a6-d257-4e13-bb3f-6bf831f441d3 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Request method failure captured: Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236 HTTP/1.1 Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxNxYS28hOFx0LP3_rjE0zM7fFGOM-IXKgzGSLp6Uah7H-53UcuAl146-IqyWBae0vYXJnkOo0c5-gNV4TShllOBvjjDNs5mW52aJFLieIvFyZP8fcRPGbc58gdbAAejCa10ZzLYM6RaxfizRyug22bKh6mmsYzuHvJ2s9t18J7uII Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 577132f31a0d4c609b927067d45f3105 Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:02:49.661690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_577132f31a0d4c609b927067d45f3105", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/577132f31a0d4c609b927067d45f3105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/577132f31a0d4c609b927067d45f3105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/577132f31a0d4c609b927067d45f3105"}]}] Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 577132f31a0d4c609b927067d45f3105 Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-195972273 Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-VolumesSnapshotsTestJSON-195972273-project Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 8980e83b77e749339c551bbe54fc40bf Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-VolumesSnapshotsTestJSON-195972273-project Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'a27514ef-a863-4622-9e76-c308abc5c236'} Aug 18 11:02:49.664364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. (HTTP 404) (Request-ID: req-b9f44596-1748-440e-81e5-bbeee05a811d) Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.665578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:02:49.668571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 11:02:49.670431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-353f99a6-d257-4e13-bb3f-6bf831f441d3 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] Returning 404 to user: Volume a27514ef-a863-4622-9e76-c308abc5c236 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-353f99a6-d257-4e13-bb3f-6bf831f441d3 tempest-VolumesSnapshotsTestJSON-195972273 tempest-VolumesSnapshotsTestJSON-195972273-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236" status: 404 len: 109 microversion: 2.1 time: 0.133518 Aug 18 11:02:49.675172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 14/28] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:49 2022] GET /compute/v2.1/os-volumes/a27514ef-a863-4622-9e76-c308abc5c236 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:02:49.725332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-2658d88b-4196-48e3-959b-fc0fc6771e18 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] HTTP exception thrown: Volume tempest-invalid-672138922 could not be found. Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2658d88b-4196-48e3-959b-fc0fc6771e18 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Request method failure captured: Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-672138922 HTTP/1.1 Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxYEGbeWA784bR2h1ukAgL8pY5xzSTfhs-MRigGRmosQfv6qgIwERKmWVffSGzgDdvBzMaNjqT2OsqB4nDwu0NJMotAmburxuhtVIdrsOrY4lb97AVmdFZTbN6BOIzjHvRl04jwx7gdAj2i47El8llZN8N2jLYaM4hlQ1n8bJe7J9E Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:02:49.729981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_83c296e31a604c23b028c480c90270b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/83c296e31a604c23b028c480c90270b4"}]}] Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 7cedc379cbe243bebeafa336bd078da7 Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Volume tempest-invalid-672138922 could not be found. Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': 'tempest-invalid-672138922'} Aug 18 11:02:49.731222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-672138922 could not be found. (HTTP 404) (Request-ID: req-04ca7173-1003-4608-a8f6-b8291cd7bf52) Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.731847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 11:02:49.732715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-672138922 could not be found. Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:02:49.733684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-672138922 could not be found. Aug 18 11:02:49.734637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.734637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.734637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.734637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.734637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.734637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.734637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:02:49.734637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:02:49.734637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-672138922 could not be found. Aug 18 11:02:49.734637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.735945 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2658d88b-4196-48e3-959b-fc0fc6771e18 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Returning 404 to user: Volume tempest-invalid-672138922 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:49.736934 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2658d88b-4196-48e3-959b-fc0fc6771e18 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-672138922" status: 404 len: 98 microversion: 2.1 time: 0.106346 Aug 18 11:02:49.737655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 15/29] 10.222.0.15 () {58 vars in 1215 bytes} [Thu Aug 18 11:02:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-672138922 => generated 98 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:02:49.755283 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0dc1eb9d-9db6-45a9-a449-76526d23e018 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009987 Aug 18 11:02:49.756232 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 15/30] 10.222.0.15 () {58 vars in 1140 bytes} [Thu Aug 18 11:02:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 11:02:49.765242 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b97e45c1-5574-42f5-a79b-eed6d12dd5d2 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003742 Aug 18 11:02:49.766376 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 16/31] 10.222.0.15 () {58 vars in 1137 bytes} [Thu Aug 18 11:02:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 11:02:49.778077 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5ad2d613-007e-441d-9b34-aab004f43ac6 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Calling method '.version_select at 0x7f7eca97cb80>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:49.854150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-5ad2d613-007e-441d-9b34-aab004f43ac6 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] HTTP exception thrown: Volume c759b67f-0e76-4071-a2c1-1306d9764487 could not be found. Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5ad2d613-007e-441d-9b34-aab004f43ac6 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Request method failure captured: Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: DELETE /compute/v2.1/os-volumes/c759b67f-0e76-4071-a2c1-1306d9764487 HTTP/1.1 Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxYEGbeWA784bR2h1ukAgL8pY5xzSTfhs-MRigGRmosQfv6qgIwERKmWVffSGzgDdvBzMaNjqT2OsqB4nDwu0NJMotAmburxuhtVIdrsOrY4lb97AVmdFZTbN6BOIzjHvRl04jwx7gdAj2i47El8llZN8N2jLYaM4hlQ1n8bJe7J9E Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:02:49.859245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_83c296e31a604c23b028c480c90270b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/83c296e31a604c23b028c480c90270b4"}]}] Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 7cedc379cbe243bebeafa336bd078da7 Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Volume c759b67f-0e76-4071-a2c1-1306d9764487 could not be found. Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'c759b67f-0e76-4071-a2c1-1306d9764487'} Aug 18 11:02:49.860468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c759b67f-0e76-4071-a2c1-1306d9764487 could not be found. (HTTP 404) (Request-ID: req-54b031aa-31f5-4b48-876e-ac96eb5ad67d) Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.861204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 11:02:49.862275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c759b67f-0e76-4071-a2c1-1306d9764487 could not be found. Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 11:02:49.863241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c759b67f-0e76-4071-a2c1-1306d9764487 could not be found. Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c759b67f-0e76-4071-a2c1-1306d9764487 could not be found. Aug 18 11:02:49.864309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.868048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5ad2d613-007e-441d-9b34-aab004f43ac6 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Returning 404 to user: Volume c759b67f-0e76-4071-a2c1-1306d9764487 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:49.872932 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5ad2d613-007e-441d-9b34-aab004f43ac6 tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/c759b67f-0e76-4071-a2c1-1306d9764487" status: 404 len: 109 microversion: 2.1 time: 0.098799 Aug 18 11:02:49.876447 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 16/32] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Aug 18 11:02:49 2022] DELETE /compute/v2.1/os-volumes/c759b67f-0e76-4071-a2c1-1306d9764487 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:02:49.887116 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8e98d690-ad84-452f-ab5a-1c0373681f4e tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Calling method '.version_select at 0x7f7eca94a670>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:49.955925 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-8e98d690-ad84-452f-ab5a-1c0373681f4e tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] HTTP exception thrown: Volume 2aefc0f4-835e-4427-9acb-e4824ade1fe5 could not be found. Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8e98d690-ad84-452f-ab5a-1c0373681f4e tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Request method failure captured: Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/os-volumes/2aefc0f4-835e-4427-9acb-e4824ade1fe5 HTTP/1.1 Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxYEGbeWA784bR2h1ukAgL8pY5xzSTfhs-MRigGRmosQfv6qgIwERKmWVffSGzgDdvBzMaNjqT2OsqB4nDwu0NJMotAmburxuhtVIdrsOrY4lb97AVmdFZTbN6BOIzjHvRl04jwx7gdAj2i47El8llZN8N2jLYaM4hlQ1n8bJe7J9E Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:02:49.958583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_83c296e31a604c23b028c480c90270b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/83c296e31a604c23b028c480c90270b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/83c296e31a604c23b028c480c90270b4"}]}] Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 83c296e31a604c23b028c480c90270b4 Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-VolumesNegativeTest-1900325797 Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 7cedc379cbe243bebeafa336bd078da7 Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-VolumesNegativeTest-1900325797-project Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Volume 2aefc0f4-835e-4427-9acb-e4824ade1fe5 could not be found. Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '2aefc0f4-835e-4427-9acb-e4824ade1fe5'} Aug 18 11:02:49.960824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2aefc0f4-835e-4427-9acb-e4824ade1fe5 could not be found. (HTTP 404) (Request-ID: req-ba5144d2-0ba2-4a89-9f2f-1b0fba169c7d) Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.961668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:02:49.963398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2aefc0f4-835e-4427-9acb-e4824ade1fe5 could not be found. Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 11:02:49.973905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2aefc0f4-835e-4427-9acb-e4824ade1fe5 could not be found. Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2aefc0f4-835e-4427-9acb-e4824ade1fe5 could not be found. Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8e98d690-ad84-452f-ab5a-1c0373681f4e tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] Returning 404 to user: Volume 2aefc0f4-835e-4427-9acb-e4824ade1fe5 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8e98d690-ad84-452f-ab5a-1c0373681f4e tempest-VolumesNegativeTest-1900325797 tempest-VolumesNegativeTest-1900325797-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2aefc0f4-835e-4427-9acb-e4824ade1fe5" status: 404 len: 109 microversion: 2.1 time: 0.080516 Aug 18 11:02:49.975965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 17/33] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:02:49 2022] GET /compute/v2.1/os-volumes/2aefc0f4-835e-4427-9acb-e4824ade1fe5 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:02:51.616491 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1400295216", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:51.985445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] validate_networks() for [('7a9abce7-f2b6-498b-a66c-e1abdcf1f879', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:02:53.038067 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1669691198", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "networks": [{"uuid": "efab9403-bdc4-4c75-afda-d43e6f368549"}]}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:53.428896 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.network.neutron [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] validate_networks() for [('efab9403-bdc4-4c75-afda-d43e6f368549', None, None, None, None, None)] {{(pid=120800) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:02:55.129621 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:02:55.130181 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:02:55.130482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:02:55.130934 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:02:55.131359 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:02:55.168421 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:02:55.171240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:02:55.171733 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:02:55.177121 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:02:55.178589 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:02:55.179244 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:02:55.249603 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Getting quotas for project ae09c11177204226a2aa5bb600ee575b. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:02:55.260215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Getting quotas for user 074cfcc7943349a490b29cd4ae3364cb and project ae09c11177204226a2aa5bb600ee575b. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:02:55.277836 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:02:55.283536 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:02:55.486249 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-de87ae15-fcec-4b7a-94ce-3c9a60184412 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.466352 Aug 18 11:02:55.486909 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 17/34] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:02:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 4468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:02:56.077741 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2920bc8d-5d4e-4597-a688-fe5cb980a8bd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Action: 'create', calling method: .version_select at 0x7f7ec9fe9e50>, body: {"keypair": {"name": "tempest-keypair-1621352910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC/EKrboDxiAEfhTDGZ8IPutoPq3UGgDHNk3vX7RxGyMLBKDjHby+/dFNwM6tDchiVJEuZcN4XCEo9Q50siz/qYGLL75FBiltv9PbP9EOGK36xCYTjGcjavMS7eCaY61Q=="}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:56.171290 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-2920bc8d-5d4e-4597-a688-fe5cb980a8bd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Getting quotas for project 3c723b1181c94699b389f0fc03e19af6. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:02:56.185185 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-2920bc8d-5d4e-4597-a688-fe5cb980a8bd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Getting quotas for user 7dc5501d59fb4593b405f0e9bd2e49ef and project 3c723b1181c94699b389f0fc03e19af6. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:02:56.261643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2920bc8d-5d4e-4597-a688-fe5cb980a8bd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.763878 Aug 18 11:02:56.269412 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 18/35] 10.222.0.15 () {62 vars in 1200 bytes} [Thu Aug 18 11:02:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 766 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 11:02:56.275927 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6e2ad5ca-b17e-4d9e-8a9b-5d5003c20470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:56.276846 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6e2ad5ca-b17e-4d9e-8a9b-5d5003c20470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:02:56.438496 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Flavor limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:02:56.439203 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Image limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:02:56.439622 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Flavor pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:02:56.440031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Image pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:02:56.440445 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:02:56.484869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:02:56.485366 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:02:56.497505 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:02:56.498438 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:02:56.498927 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:02:56.499365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:02:56.567596 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6e2ad5ca-b17e-4d9e-8a9b-5d5003c20470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:02:56.583537 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Getting quotas for project 532114507c3e4c8e8d14dd3cfdd65c6a. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:02:56.596551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Getting quotas for user 10b548df8cdf40d4879efbd34563385e and project 532114507c3e4c8e8d14dd3cfdd65c6a. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:02:56.598240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6e2ad5ca-b17e-4d9e-8a9b-5d5003c20470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1222 microversion: 2.1 time: 0.334489 Aug 18 11:02:56.606539 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 19/36] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:02:56 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1222 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:02:56.658336 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Going to run 1 instances... {{(pid=120800) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:02:56.665984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:02:56.841016 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2ccd6a8f-d3c5-439b-a64c-08e0f9fa6c1b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.352978 Aug 18 11:02:56.842069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:02:56.854134 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a82aae6d-443a-4124-9e0b-8f604b31f87e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:56.854747 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a82aae6d-443a-4124-9e0b-8f604b31f87e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:02:57.024063 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a82aae6d-443a-4124-9e0b-8f604b31f87e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:02:57.047213 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a82aae6d-443a-4124-9e0b-8f604b31f87e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1215 microversion: 2.1 time: 0.197566 Aug 18 11:02:57.047822 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 20/38] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:02:56 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:02:57.296888 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1412264907", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:57.475492 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.network.neutron [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] validate_networks() for [('7a9abce7-f2b6-498b-a66c-e1abdcf1f879', None, None, None, None, None)] {{(pid=120800) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:02:58.598111 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-13194033-d7a6-408d-86f8-e350aad5690a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: .version_select at 0x7f7ec8fc8c10>, body: {"keypair": {"name": "tempest-keypair-121521980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFguGD9FDFFE7Eszyz1w6RdX+a8bcHdsuOTjGi4U+FZ9JFYe9P58Q/Y3C0k7Dje6ZX8BL646AHG7Co2n4Yr6Xd8yA3054v1bYkWLuYEY85jiPi0RA2kiABIOF97FndR5/A=="}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:02:58.639168 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-13194033-d7a6-408d-86f8-e350aad5690a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for project 397eac573c2d473e881b07c87255700c. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:02:58.649226 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-13194033-d7a6-408d-86f8-e350aad5690a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for user 57e117589fc14e4d9d8d8494bddf9c12 and project 397eac573c2d473e881b07c87255700c. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:02:58.731873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-13194033-d7a6-408d-86f8-e350aad5690a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.142078 Aug 18 11:02:58.743193 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 21/39] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Aug 18 11:02:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:02:58.748574 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d04a3def-58c1-4bc9-bca6-1e68a7283a32 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:58.763277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d04a3def-58c1-4bc9-bca6-1e68a7283a32 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:02:59.025158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Flavor limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:02:59.025752 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Image limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:02:59.026466 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Flavor pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:02:59.026981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Image pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:02:59.027524 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:02:59.048702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:02:59.053415 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:02:59.056937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:02:59.058475 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:02:59.063118 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:02:59.064816 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:02:59.119759 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Getting quotas for project ae09c11177204226a2aa5bb600ee575b. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:02:59.134487 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Getting quotas for user 074cfcc7943349a490b29cd4ae3364cb and project ae09c11177204226a2aa5bb600ee575b. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:02:59.150975 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Going to run 1 instances... {{(pid=120800) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:02:59.154440 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:02:59.265402 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5519280a-314a-48eb-9516-e318d80b4db4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.973212 Aug 18 11:02:59.267547 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 19/40] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:02:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:02:59.292211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-64436078-b7da-427e-ba12-144fbe9fa675 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:02:59.294182 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-64436078-b7da-427e-ba12-144fbe9fa675 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:02:59.715907 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d04a3def-58c1-4bc9-bca6-1e68a7283a32 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:02:59.723476 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d04a3def-58c1-4bc9-bca6-1e68a7283a32 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1215 microversion: 2.1 time: 0.978809 Aug 18 11:02:59.724943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 22/41] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:02:58 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1215 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:02:59.915028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-64436078-b7da-427e-ba12-144fbe9fa675 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:02:59.969232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-64436078-b7da-427e-ba12-144fbe9fa675 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1222 microversion: 2.1 time: 0.692497 Aug 18 11:02:59.975507 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 20/42] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:02:59 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1222 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:00.751003 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e795ce9b-b127-48f8-a28e-f007307960a5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:00.752522 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e795ce9b-b127-48f8-a28e-f007307960a5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:00.768337 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e795ce9b-b127-48f8-a28e-f007307960a5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:00.768845 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e795ce9b-b127-48f8-a28e-f007307960a5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:00.769508 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e795ce9b-b127-48f8-a28e-f007307960a5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:00.770298 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e795ce9b-b127-48f8-a28e-f007307960a5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:00.772437 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e795ce9b-b127-48f8-a28e-f007307960a5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:00.775823 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e795ce9b-b127-48f8-a28e-f007307960a5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:00.996087 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-55bafcae-93e9-4b14-b22a-f1f9ff2c6b25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:01.000223 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-55bafcae-93e9-4b14-b22a-f1f9ff2c6b25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:01.025349 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55bafcae-93e9-4b14-b22a-f1f9ff2c6b25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:01.025944 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55bafcae-93e9-4b14-b22a-f1f9ff2c6b25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:01.026397 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55bafcae-93e9-4b14-b22a-f1f9ff2c6b25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:01.029388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55bafcae-93e9-4b14-b22a-f1f9ff2c6b25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:01.034411 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55bafcae-93e9-4b14-b22a-f1f9ff2c6b25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:01.036406 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55bafcae-93e9-4b14-b22a-f1f9ff2c6b25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:01.584108 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-55bafcae-93e9-4b14-b22a-f1f9ff2c6b25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:01.618287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-55bafcae-93e9-4b14-b22a-f1f9ff2c6b25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1218 microversion: 2.1 time: 0.625901 Aug 18 11:03:01.621682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 21/43] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:00 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1218 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:01.829271 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e795ce9b-b127-48f8-a28e-f007307960a5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:01.909409 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e795ce9b-b127-48f8-a28e-f007307960a5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1267 microversion: 2.1 time: 1.161314 Aug 18 11:03:01.931833 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 23/44] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:00 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1267 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:02.644394 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1f3cd075-611d-44c3-8125-b745cfec8065 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:02.645030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1f3cd075-611d-44c3-8125-b745cfec8065 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:02.658686 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f3cd075-611d-44c3-8125-b745cfec8065 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:02.661095 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f3cd075-611d-44c3-8125-b745cfec8065 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:02.665493 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f3cd075-611d-44c3-8125-b745cfec8065 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:02.671296 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f3cd075-611d-44c3-8125-b745cfec8065 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:02.672000 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f3cd075-611d-44c3-8125-b745cfec8065 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:02.672650 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f3cd075-611d-44c3-8125-b745cfec8065 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:02.832607 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1249637443", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb9079f2-48dc-4905-914c-07a7ceac168a"}], "security_groups": [{"name": "tempest-securitygroup--435252336"}], "key_name": "tempest-keypair-1621352910", "user_data": "}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:02.972104 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1f3cd075-611d-44c3-8125-b745cfec8065 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:02.985818 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1f3cd075-611d-44c3-8125-b745cfec8065 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1280 microversion: 2.1 time: 0.345398 Aug 18 11:03:03.000197 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 22/45] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:02 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1280 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:03.018847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-690799b3-8f5a-446f-b836-2a797c7fccd5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:03.019473 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-690799b3-8f5a-446f-b836-2a797c7fccd5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:03.032967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-690799b3-8f5a-446f-b836-2a797c7fccd5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:03.033468 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-690799b3-8f5a-446f-b836-2a797c7fccd5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:03.033934 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-690799b3-8f5a-446f-b836-2a797c7fccd5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:03.034646 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-690799b3-8f5a-446f-b836-2a797c7fccd5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:03.045959 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-690799b3-8f5a-446f-b836-2a797c7fccd5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:03.046509 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-690799b3-8f5a-446f-b836-2a797c7fccd5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:03.263927 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-690799b3-8f5a-446f-b836-2a797c7fccd5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:03.273137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-690799b3-8f5a-446f-b836-2a797c7fccd5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1273 microversion: 2.1 time: 0.271696 Aug 18 11:03:03.295092 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 23/46] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:03 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:03.344040 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] validate_networks() for [('bb9079f2-48dc-4905-914c-07a7ceac168a', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:03:04.008334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a571fcea-db6a-4946-8c5e-9290ff9d61d7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:04.008990 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a571fcea-db6a-4946-8c5e-9290ff9d61d7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:04.023327 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a571fcea-db6a-4946-8c5e-9290ff9d61d7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:04.025279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a571fcea-db6a-4946-8c5e-9290ff9d61d7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:04.026631 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a571fcea-db6a-4946-8c5e-9290ff9d61d7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:04.027661 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a571fcea-db6a-4946-8c5e-9290ff9d61d7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:04.028301 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a571fcea-db6a-4946-8c5e-9290ff9d61d7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:04.028920 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a571fcea-db6a-4946-8c5e-9290ff9d61d7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:04.323027 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a571fcea-db6a-4946-8c5e-9290ff9d61d7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:04.331220 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a571fcea-db6a-4946-8c5e-9290ff9d61d7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1280 microversion: 2.1 time: 0.327495 Aug 18 11:03:04.336512 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 24/47] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:04 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1280 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:04.361673 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-aca53f3a-8811-4017-958f-4c6a2c854e6f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:04.362741 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-aca53f3a-8811-4017-958f-4c6a2c854e6f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:04.392564 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aca53f3a-8811-4017-958f-4c6a2c854e6f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:04.393446 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aca53f3a-8811-4017-958f-4c6a2c854e6f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:04.394112 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aca53f3a-8811-4017-958f-4c6a2c854e6f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:04.396798 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aca53f3a-8811-4017-958f-4c6a2c854e6f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:04.400499 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aca53f3a-8811-4017-958f-4c6a2c854e6f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:04.411377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aca53f3a-8811-4017-958f-4c6a2c854e6f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:04.712431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-aca53f3a-8811-4017-958f-4c6a2c854e6f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:04.720433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-aca53f3a-8811-4017-958f-4c6a2c854e6f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1273 microversion: 2.1 time: 0.380726 Aug 18 11:03:04.723288 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:04 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1273 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:05.227359 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:05.355173 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ae0a3cbb-c397-43d1-be6c-8baf7aa7313c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:05.355908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ae0a3cbb-c397-43d1-be6c-8baf7aa7313c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:05.367423 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae0a3cbb-c397-43d1-be6c-8baf7aa7313c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:05.368066 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae0a3cbb-c397-43d1-be6c-8baf7aa7313c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:05.368769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae0a3cbb-c397-43d1-be6c-8baf7aa7313c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:05.370133 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae0a3cbb-c397-43d1-be6c-8baf7aa7313c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:05.371300 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae0a3cbb-c397-43d1-be6c-8baf7aa7313c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:05.372692 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae0a3cbb-c397-43d1-be6c-8baf7aa7313c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:06.676813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ae0a3cbb-c397-43d1-be6c-8baf7aa7313c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:06.692961 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ae0a3cbb-c397-43d1-be6c-8baf7aa7313c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 1.341642 Aug 18 11:03:06.716601 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 26/49] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:05 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:06.723767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2a28c3f8-d310-447c-be03-0faaa9abf7fd tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:06.724997 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2a28c3f8-d310-447c-be03-0faaa9abf7fd tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:06.761950 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a28c3f8-d310-447c-be03-0faaa9abf7fd tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:06.762448 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a28c3f8-d310-447c-be03-0faaa9abf7fd tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:06.774449 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a28c3f8-d310-447c-be03-0faaa9abf7fd tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:06.775556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a28c3f8-d310-447c-be03-0faaa9abf7fd tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:06.777530 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a28c3f8-d310-447c-be03-0faaa9abf7fd tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:06.782311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a28c3f8-d310-447c-be03-0faaa9abf7fd tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:07.091431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2a28c3f8-d310-447c-be03-0faaa9abf7fd tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:07.095385 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2a28c3f8-d310-447c-be03-0faaa9abf7fd tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1273 microversion: 2.1 time: 0.377346 Aug 18 11:03:07.113507 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 27/50] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:06 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1273 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:07.723557 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-aceef6fa-2133-4b87-9444-92f776db4a51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:07.724190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-aceef6fa-2133-4b87-9444-92f776db4a51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:07.739226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aceef6fa-2133-4b87-9444-92f776db4a51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:07.740252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aceef6fa-2133-4b87-9444-92f776db4a51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:07.740701 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aceef6fa-2133-4b87-9444-92f776db4a51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:07.741594 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aceef6fa-2133-4b87-9444-92f776db4a51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:07.742244 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aceef6fa-2133-4b87-9444-92f776db4a51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:07.742835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aceef6fa-2133-4b87-9444-92f776db4a51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:08.629141 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-aceef6fa-2133-4b87-9444-92f776db4a51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:08.640721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-aceef6fa-2133-4b87-9444-92f776db4a51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.919772 Aug 18 11:03:08.647065 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 28/51] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:07 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:08.667142 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-05d32bee-d75f-4f03-ac6c-49cf884c6447 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:08.685158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-05d32bee-d75f-4f03-ac6c-49cf884c6447 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:08.705697 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d32bee-d75f-4f03-ac6c-49cf884c6447 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:08.706518 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d32bee-d75f-4f03-ac6c-49cf884c6447 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:08.707746 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d32bee-d75f-4f03-ac6c-49cf884c6447 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:08.709016 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d32bee-d75f-4f03-ac6c-49cf884c6447 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:08.709747 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d32bee-d75f-4f03-ac6c-49cf884c6447 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:08.711097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d32bee-d75f-4f03-ac6c-49cf884c6447 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:09.096072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=4 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:09.567262 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-05d32bee-d75f-4f03-ac6c-49cf884c6447 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:09.578463 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-05d32bee-d75f-4f03-ac6c-49cf884c6447 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.928314 Aug 18 11:03:09.579050 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 29/52] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:08 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:09.667195 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ec86ffc4-ffee-4d96-82a2-549d0dd5e29e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:09.668018 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ec86ffc4-ffee-4d96-82a2-549d0dd5e29e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:09.692900 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ec86ffc4-ffee-4d96-82a2-549d0dd5e29e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:09.693685 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ec86ffc4-ffee-4d96-82a2-549d0dd5e29e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:09.694332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ec86ffc4-ffee-4d96-82a2-549d0dd5e29e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:09.695066 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ec86ffc4-ffee-4d96-82a2-549d0dd5e29e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:09.695602 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ec86ffc4-ffee-4d96-82a2-549d0dd5e29e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:09.696044 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ec86ffc4-ffee-4d96-82a2-549d0dd5e29e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:09.720429 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=20 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:09.765355 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:03:09.768972 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:03:09.769543 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:03:09.770118 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:03:09.770711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:03:09.795928 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:09.803639 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:09.804682 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:09.807850 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:09.808589 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:09.810078 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:09.892414 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Getting quotas for project 3c723b1181c94699b389f0fc03e19af6. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:03:09.914523 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Getting quotas for user 7dc5501d59fb4593b405f0e9bd2e49ef and project 3c723b1181c94699b389f0fc03e19af6. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:03:09.953134 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:03:09.970082 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=14 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:09.973292 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:03:10.095658 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-bcd2ceea-8c43-41ca-90b3-fc8b1df592a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 7.267641 Aug 18 11:03:10.101807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 24/53] 10.222.0.15 () {62 vars in 1188 bytes} [Thu Aug 18 11:03:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 7274 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:03:10.112938 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-769c72fa-5c21-44f2-a4f5-90f1598ec743 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:10.119091 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-769c72fa-5c21-44f2-a4f5-90f1598ec743 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:10.478273 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-769c72fa-5c21-44f2-a4f5-90f1598ec743 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:10.490328 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-769c72fa-5c21-44f2-a4f5-90f1598ec743 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:10.492476 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-769c72fa-5c21-44f2-a4f5-90f1598ec743 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:10.493820 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-769c72fa-5c21-44f2-a4f5-90f1598ec743 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1282 microversion: 2.20 time: 0.386948 Aug 18 11:03:10.526048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 25/54] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:10 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1282 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:03:10.671457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-cdb9c2e0-1ba7-4b5e-92d2-720932cc4939 req-9a73ad6a-c366-4d6e-b18a-0fbe0cbdc312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84d6955-9f03-4572-8bc7-afe5a9051ca2", "tag": "b889406a-fd6b-4f05-afb7-b8863a6cfc75"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:10.695430 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-cdb9c2e0-1ba7-4b5e-92d2-720932cc4939 req-9a73ad6a-c366-4d6e-b18a-0fbe0cbdc312 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:10.725706 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-cdb9c2e0-1ba7-4b5e-92d2-720932cc4939 req-9a73ad6a-c366-4d6e-b18a-0fbe0cbdc312 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:10.726929 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-cdb9c2e0-1ba7-4b5e-92d2-720932cc4939 req-9a73ad6a-c366-4d6e-b18a-0fbe0cbdc312 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:10.791811 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-cdb9c2e0-1ba7-4b5e-92d2-720932cc4939 req-9a73ad6a-c366-4d6e-b18a-0fbe0cbdc312 service nova] Creating event network-changed:b889406a-fd6b-4f05-afb7-b8863a6cfc75 for instance b84d6955-9f03-4572-8bc7-afe5a9051ca2 on hv-cinder-82660 Aug 18 11:03:10.792382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-cdb9c2e0-1ba7-4b5e-92d2-720932cc4939 req-9a73ad6a-c366-4d6e-b18a-0fbe0cbdc312 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:03:10.792774 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-cdb9c2e0-1ba7-4b5e-92d2-720932cc4939 req-9a73ad6a-c366-4d6e-b18a-0fbe0cbdc312 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:03:10.801456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0d5f4b74-3ffd-485b-a053-1ddcce40ec69 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:10.810203 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0d5f4b74-3ffd-485b-a053-1ddcce40ec69 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:10.810889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0d5f4b74-3ffd-485b-a053-1ddcce40ec69 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:10.812127 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0d5f4b74-3ffd-485b-a053-1ddcce40ec69 None None] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:10.812877 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0d5f4b74-3ffd-485b-a053-1ddcce40ec69 None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:10.813549 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0d5f4b74-3ffd-485b-a053-1ddcce40ec69 None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:10.849957 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.compute.rpcapi [None req-0d5f4b74-3ffd-485b-a053-1ddcce40ec69 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 11:03:10.863997 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0d5f4b74-3ffd-485b-a053-1ddcce40ec69 None None] Releasing lock "compute-rpcapi-router" {{(pid=120801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:03:10.901443 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ec86ffc4-ffee-4d96-82a2-549d0dd5e29e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:10.909447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ec86ffc4-ffee-4d96-82a2-549d0dd5e29e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 1.248884 Aug 18 11:03:10.910046 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 30/55] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:09 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:10.944033 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-eb889085-19b3-48d0-aefd-692c39ebd41e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:10.944296 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0d5f4b74-3ffd-485b-a053-1ddcce40ec69 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.412506 Aug 18 11:03:10.945458 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 26/56] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:10.947864 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-eb889085-19b3-48d0-aefd-692c39ebd41e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:10.962431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-eb889085-19b3-48d0-aefd-692c39ebd41e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:10.972939 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-eb889085-19b3-48d0-aefd-692c39ebd41e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:10.973617 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-eb889085-19b3-48d0-aefd-692c39ebd41e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:10.978275 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-eb889085-19b3-48d0-aefd-692c39ebd41e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:10.979089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-eb889085-19b3-48d0-aefd-692c39ebd41e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:10.979778 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-eb889085-19b3-48d0-aefd-692c39ebd41e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:11.526854 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:11.527827 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:11.561337 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:11.561785 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:11.562241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:11.568636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:11.573551 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:11.574199 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:11.977876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-eb889085-19b3-48d0-aefd-692c39ebd41e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:11.991945 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-eb889085-19b3-48d0-aefd-692c39ebd41e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 1.059716 Aug 18 11:03:11.997204 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 31/57] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:10 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:12.046396 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f8123762-9e1b-4cdf-9410-1543754bd791 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:12.053354 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f8123762-9e1b-4cdf-9410-1543754bd791 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:12.065866 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f8123762-9e1b-4cdf-9410-1543754bd791 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:12.068232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f8123762-9e1b-4cdf-9410-1543754bd791 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:12.070015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f8123762-9e1b-4cdf-9410-1543754bd791 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:12.078687 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f8123762-9e1b-4cdf-9410-1543754bd791 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:12.079508 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f8123762-9e1b-4cdf-9410-1543754bd791 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:12.081003 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f8123762-9e1b-4cdf-9410-1543754bd791 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:12.250597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:12.260855 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:12.282866 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:12.291850 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5a8fdbcb-f41e-4ff2-a154-04db8c723c42 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1278 microversion: 2.20 time: 0.770870 Aug 18 11:03:12.297893 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 27/58] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:11 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1278 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:03:12.504775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f8123762-9e1b-4cdf-9410-1543754bd791 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:12.521100 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f8123762-9e1b-4cdf-9410-1543754bd791 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.520478 Aug 18 11:03:12.526378 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 32/59] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:11 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:13.024409 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-37d71a8c-5359-4b71-9da1-8fa059847155 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:13.025627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-37d71a8c-5359-4b71-9da1-8fa059847155 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:13.051401 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37d71a8c-5359-4b71-9da1-8fa059847155 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:13.052537 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37d71a8c-5359-4b71-9da1-8fa059847155 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:13.054189 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37d71a8c-5359-4b71-9da1-8fa059847155 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:13.055086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37d71a8c-5359-4b71-9da1-8fa059847155 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:13.055550 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37d71a8c-5359-4b71-9da1-8fa059847155 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:13.055983 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37d71a8c-5359-4b71-9da1-8fa059847155 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:13.168667 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1589902830", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88f1fd75-57ea-4549-97f2-02b6b8fc6e1b"}], "security_groups": [{"name": "tempest-securitygroup--799009484"}], "key_name": "tempest-keypair-121521980", "user_data": "}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:13.695220 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.network.neutron [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] validate_networks() for [('88f1fd75-57ea-4549-97f2-02b6b8fc6e1b', None, None, None, None, None)] {{(pid=120800) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:03:14.388211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-37d71a8c-5359-4b71-9da1-8fa059847155 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:14.404342 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-37d71a8c-5359-4b71-9da1-8fa059847155 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 1.385031 Aug 18 11:03:14.404948 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 28/60] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:13 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:14.422699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:14.424003 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:14.432185 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:14.432680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:14.435719 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:14.441324 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:14.442120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:14.443051 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:14.641119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:14.667724 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:14.676236 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:14.679383 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c0927664-2c18-4b88-a96b-f9f25a6fd939 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1340 microversion: 2.20 time: 0.260930 Aug 18 11:03:14.685046 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 29/61] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:14 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1340 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:14.706911 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-843f700d-9fe2-4f15-acd4-fa09393afd44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:14.711438 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-843f700d-9fe2-4f15-acd4-fa09393afd44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:14.733728 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-843f700d-9fe2-4f15-acd4-fa09393afd44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:14.737627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-843f700d-9fe2-4f15-acd4-fa09393afd44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:14.741790 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-843f700d-9fe2-4f15-acd4-fa09393afd44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:14.743924 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-843f700d-9fe2-4f15-acd4-fa09393afd44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:14.745818 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-843f700d-9fe2-4f15-acd4-fa09393afd44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:14.747440 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-843f700d-9fe2-4f15-acd4-fa09393afd44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:15.354400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-843f700d-9fe2-4f15-acd4-fa09393afd44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:15.374985 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-843f700d-9fe2-4f15-acd4-fa09393afd44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.684727 Aug 18 11:03:15.379837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 30/62] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:14 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:15.854919 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-265060f5-4307-4118-b768-fa491ddaa5eb req-b88fd65c-a28b-403c-81de-48195269301e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf6cfd1-8e48-4e4e-9a3b-05363568e762", "tag": "c75ad995-e60d-4b15-bf38-31d1772db191"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:15.877096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-265060f5-4307-4118-b768-fa491ddaa5eb req-b88fd65c-a28b-403c-81de-48195269301e service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:15.877781 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-265060f5-4307-4118-b768-fa491ddaa5eb req-b88fd65c-a28b-403c-81de-48195269301e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:15.878421 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-265060f5-4307-4118-b768-fa491ddaa5eb req-b88fd65c-a28b-403c-81de-48195269301e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:15.894018 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-265060f5-4307-4118-b768-fa491ddaa5eb req-b88fd65c-a28b-403c-81de-48195269301e service nova] Creating event network-changed:c75ad995-e60d-4b15-bf38-31d1772db191 for instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 on hv-cinder-82660 Aug 18 11:03:15.903547 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-265060f5-4307-4118-b768-fa491ddaa5eb req-b88fd65c-a28b-403c-81de-48195269301e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.518441 Aug 18 11:03:15.905048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 31/63] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:15.917713 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-130e509f-54d9-4b3e-a685-be7350404edf tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:15.919579 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-130e509f-54d9-4b3e-a685-be7350404edf tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:15.936383 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-130e509f-54d9-4b3e-a685-be7350404edf tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:15.936946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-130e509f-54d9-4b3e-a685-be7350404edf tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:15.937373 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-130e509f-54d9-4b3e-a685-be7350404edf tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:15.938592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-130e509f-54d9-4b3e-a685-be7350404edf tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:15.938592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-130e509f-54d9-4b3e-a685-be7350404edf tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:15.939003 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-130e509f-54d9-4b3e-a685-be7350404edf tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:16.369579 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-130e509f-54d9-4b3e-a685-be7350404edf tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:16.378561 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-130e509f-54d9-4b3e-a685-be7350404edf tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.472336 Aug 18 11:03:16.393147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 32/64] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:15 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:16.399889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:16.400825 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:16.407332 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:16.408240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:16.408884 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:16.409863 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:16.410651 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:16.411360 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:16.568770 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:16.584885 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:16.588188 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:16.590654 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-796fafae-8be7-43fd-aff1-05f14fbaaf99 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1340 microversion: 2.20 time: 0.194838 Aug 18 11:03:16.592281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 33/65] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:16 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1340 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:16.599442 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-59d477ec-5648-417f-a8e8-28a0b64f2840 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:16.600543 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-59d477ec-5648-417f-a8e8-28a0b64f2840 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:16.612270 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59d477ec-5648-417f-a8e8-28a0b64f2840 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:16.613393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59d477ec-5648-417f-a8e8-28a0b64f2840 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:16.614150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59d477ec-5648-417f-a8e8-28a0b64f2840 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:16.615136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59d477ec-5648-417f-a8e8-28a0b64f2840 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:16.616093 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59d477ec-5648-417f-a8e8-28a0b64f2840 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:16.617104 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59d477ec-5648-417f-a8e8-28a0b64f2840 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:16.619504 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Flavor limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:03:16.620019 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Image limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:03:16.620430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Flavor pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:03:16.621020 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Image pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:03:16.621629 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:03:16.648995 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:16.656597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:16.657251 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:16.660237 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:16.660676 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:16.661129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:16.702596 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for project 397eac573c2d473e881b07c87255700c. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:03:16.712607 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for user 57e117589fc14e4d9d8d8494bddf9c12 and project 397eac573c2d473e881b07c87255700c. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:03:16.742057 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Going to run 1 instances... {{(pid=120800) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:03:16.744763 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:03:16.848070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-45cd2b5a-dae2-47f2-a25a-d3cd081ef90f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.690063 Aug 18 11:03:16.854254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-59d477ec-5648-417f-a8e8-28a0b64f2840 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:16.855795 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 33/66] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:03:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 3699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:03:16.862708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-59d477ec-5648-417f-a8e8-28a0b64f2840 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.269090 Aug 18 11:03:16.873243 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 34/67] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:16 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:16.873579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-21a82d3d-17bb-4d4c-85a3-b9bb8ee562b2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:16.878017 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-21a82d3d-17bb-4d4c-85a3-b9bb8ee562b2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:17.008020 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-21a82d3d-17bb-4d4c-85a3-b9bb8ee562b2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:17.018107 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-21a82d3d-17bb-4d4c-85a3-b9bb8ee562b2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1241 microversion: 2.1 time: 0.160112 Aug 18 11:03:17.018694 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 34/68] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:16 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:17.400073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-aae9a1f4-97fc-45a2-beef-459199a3b40e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:17.400863 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-aae9a1f4-97fc-45a2-beef-459199a3b40e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:17.410960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aae9a1f4-97fc-45a2-beef-459199a3b40e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:17.413829 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aae9a1f4-97fc-45a2-beef-459199a3b40e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:17.416734 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aae9a1f4-97fc-45a2-beef-459199a3b40e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:17.417725 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aae9a1f4-97fc-45a2-beef-459199a3b40e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:17.419034 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aae9a1f4-97fc-45a2-beef-459199a3b40e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:17.420975 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aae9a1f4-97fc-45a2-beef-459199a3b40e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:17.627205 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:17.627827 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:17.647901 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:17.648358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:17.657710 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:17.658490 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:17.659750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:17.659750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:17.850708 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:17.862579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:17.864106 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:17.865286 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8121ce1d-0421-4b60-b412-57ba1b0969d8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.245627 Aug 18 11:03:17.885657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 35/69] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:17 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:17.892270 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ff247758-b743-49f6-9437-54d2c98bd9b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:17.893304 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ff247758-b743-49f6-9437-54d2c98bd9b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:17.915180 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff247758-b743-49f6-9437-54d2c98bd9b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:17.915680 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff247758-b743-49f6-9437-54d2c98bd9b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:17.916129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff247758-b743-49f6-9437-54d2c98bd9b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:17.916855 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff247758-b743-49f6-9437-54d2c98bd9b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:17.917317 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff247758-b743-49f6-9437-54d2c98bd9b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:17.918783 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff247758-b743-49f6-9437-54d2c98bd9b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:17.969424 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-aae9a1f4-97fc-45a2-beef-459199a3b40e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:17.972187 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=63 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:17.985562 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-aae9a1f4-97fc-45a2-beef-459199a3b40e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.589736 Aug 18 11:03:17.999704 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 35/70] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:17 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:18.040079 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-92169d51-8151-455b-9e73-a3f5438e0226 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:18.040700 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-92169d51-8151-455b-9e73-a3f5438e0226 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:18.045924 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:18.047660 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-92169d51-8151-455b-9e73-a3f5438e0226 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:18.048298 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-92169d51-8151-455b-9e73-a3f5438e0226 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:18.048888 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-92169d51-8151-455b-9e73-a3f5438e0226 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:18.050000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-92169d51-8151-455b-9e73-a3f5438e0226 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:18.050612 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-92169d51-8151-455b-9e73-a3f5438e0226 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:18.051359 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-92169d51-8151-455b-9e73-a3f5438e0226 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:18.161674 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-92169d51-8151-455b-9e73-a3f5438e0226 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:18.175097 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-92169d51-8151-455b-9e73-a3f5438e0226 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1245 microversion: 2.1 time: 0.139246 Aug 18 11:03:18.176217 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 36/71] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:18 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1245 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:18.181606 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-9835bc78-f9d6-4633-8313-a123a0c31aa7 req-83fdca7d-26d1-4b72-99fc-30cecde0e7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a38c9ed-092c-4a82-9581-85326a84f582", "tag": "4bed2960-285e-436c-92c4-807908aec234"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:18.193403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-9835bc78-f9d6-4633-8313-a123a0c31aa7 req-83fdca7d-26d1-4b72-99fc-30cecde0e7b7 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:18.194196 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-9835bc78-f9d6-4633-8313-a123a0c31aa7 req-83fdca7d-26d1-4b72-99fc-30cecde0e7b7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:18.194615 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-9835bc78-f9d6-4633-8313-a123a0c31aa7 req-83fdca7d-26d1-4b72-99fc-30cecde0e7b7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:18.212253 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-9835bc78-f9d6-4633-8313-a123a0c31aa7 req-83fdca7d-26d1-4b72-99fc-30cecde0e7b7 service nova] Creating event network-changed:4bed2960-285e-436c-92c4-807908aec234 for instance 9a38c9ed-092c-4a82-9581-85326a84f582 on hv-cinder-82660 Aug 18 11:03:18.219792 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-9835bc78-f9d6-4633-8313-a123a0c31aa7 req-83fdca7d-26d1-4b72-99fc-30cecde0e7b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041600 Aug 18 11:03:18.220403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 37/72] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:18.226017 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ff247758-b743-49f6-9437-54d2c98bd9b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:18.234203 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=89 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:18.238799 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ff247758-b743-49f6-9437-54d2c98bd9b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.350786 Aug 18 11:03:18.249566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 36/73] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:17 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:18.890138 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:18.891140 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:18.903197 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:18.903772 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:18.904279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:18.905208 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:18.905677 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:18.906351 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:19.009546 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1995504c-d071-4a70-8739-283295f4e7ac tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:19.010401 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1995504c-d071-4a70-8739-283295f4e7ac tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:19.012932 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:19.022450 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1995504c-d071-4a70-8739-283295f4e7ac tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:19.025718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1995504c-d071-4a70-8739-283295f4e7ac tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:19.026518 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1995504c-d071-4a70-8739-283295f4e7ac tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:19.028042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1995504c-d071-4a70-8739-283295f4e7ac tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:19.030070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1995504c-d071-4a70-8739-283295f4e7ac tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:19.031060 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1995504c-d071-4a70-8739-283295f4e7ac tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:19.161891 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:19.185432 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:19.187638 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:19.189165 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ffd455c6-7ba7-4b88-8c7d-29086347aac2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.303964 Aug 18 11:03:19.202369 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1995504c-d071-4a70-8739-283295f4e7ac tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:19.203151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:18 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:19.217494 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1995504c-d071-4a70-8739-283295f4e7ac tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.213146 Aug 18 11:03:19.228757 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 37/75] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:19 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:19.236746 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6784890f-8f18-4260-a496-23836d0a7a64 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:19.237418 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6784890f-8f18-4260-a496-23836d0a7a64 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:19.245073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6784890f-8f18-4260-a496-23836d0a7a64 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:19.245913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6784890f-8f18-4260-a496-23836d0a7a64 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:19.246557 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6784890f-8f18-4260-a496-23836d0a7a64 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:19.247439 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6784890f-8f18-4260-a496-23836d0a7a64 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:19.248123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6784890f-8f18-4260-a496-23836d0a7a64 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:19.248714 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6784890f-8f18-4260-a496-23836d0a7a64 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:19.263494 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e5c10128-b984-47a3-bfc2-473cc7a6718e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:19.264029 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e5c10128-b984-47a3-bfc2-473cc7a6718e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:19.272134 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e5c10128-b984-47a3-bfc2-473cc7a6718e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:19.272622 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e5c10128-b984-47a3-bfc2-473cc7a6718e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:19.273429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e5c10128-b984-47a3-bfc2-473cc7a6718e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:19.274443 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e5c10128-b984-47a3-bfc2-473cc7a6718e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:19.275180 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e5c10128-b984-47a3-bfc2-473cc7a6718e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:19.275608 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e5c10128-b984-47a3-bfc2-473cc7a6718e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:19.331626 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6784890f-8f18-4260-a496-23836d0a7a64 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:19.341415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6784890f-8f18-4260-a496-23836d0a7a64 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1245 microversion: 2.1 time: 0.126295 Aug 18 11:03:19.352223 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 39/76] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:19 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1245 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:19.445592 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e5c10128-b984-47a3-bfc2-473cc7a6718e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:19.453615 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e5c10128-b984-47a3-bfc2-473cc7a6718e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.194711 Aug 18 11:03:19.454318 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 38/77] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:19 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:20.225928 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:20.226549 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:20.234404 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:20.235460 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:20.235980 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:20.236984 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:20.237775 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:20.238239 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:20.246941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f084baef-d231-4d8d-a223-79445ae55823 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:20.247880 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f084baef-d231-4d8d-a223-79445ae55823 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:20.261589 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f084baef-d231-4d8d-a223-79445ae55823 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:20.261992 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f084baef-d231-4d8d-a223-79445ae55823 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:20.264532 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f084baef-d231-4d8d-a223-79445ae55823 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:20.265270 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f084baef-d231-4d8d-a223-79445ae55823 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:20.265881 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f084baef-d231-4d8d-a223-79445ae55823 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:20.266182 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f084baef-d231-4d8d-a223-79445ae55823 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:20.461851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:20.472954 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f084baef-d231-4d8d-a223-79445ae55823 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:20.476602 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:20.479291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:20.481183 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5b4933e4-b8b0-448f-bc1e-8ebc0500b99e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.261062 Aug 18 11:03:20.483156 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f084baef-d231-4d8d-a223-79445ae55823 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.242686 Aug 18 11:03:20.483729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 39/78] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:20 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:20.489362 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-408e287c-0518-44ed-a2bd-71372dfa8a44 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:20.491090 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-408e287c-0518-44ed-a2bd-71372dfa8a44 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:20.497377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-408e287c-0518-44ed-a2bd-71372dfa8a44 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:20.498151 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-408e287c-0518-44ed-a2bd-71372dfa8a44 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:20.498261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 40/79] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:20 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:20.498926 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-408e287c-0518-44ed-a2bd-71372dfa8a44 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:20.499692 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-408e287c-0518-44ed-a2bd-71372dfa8a44 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:20.500565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-408e287c-0518-44ed-a2bd-71372dfa8a44 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:20.501366 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-408e287c-0518-44ed-a2bd-71372dfa8a44 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:20.502917 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-467c6b9a-f6f3-4d9a-b63f-5c2cd992154f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:20.503978 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-467c6b9a-f6f3-4d9a-b63f-5c2cd992154f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:20.511256 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=8 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:20.513624 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-467c6b9a-f6f3-4d9a-b63f-5c2cd992154f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:20.516171 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-467c6b9a-f6f3-4d9a-b63f-5c2cd992154f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:20.516614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-467c6b9a-f6f3-4d9a-b63f-5c2cd992154f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:20.517346 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-467c6b9a-f6f3-4d9a-b63f-5c2cd992154f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:20.517897 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-467c6b9a-f6f3-4d9a-b63f-5c2cd992154f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:20.518324 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-467c6b9a-f6f3-4d9a-b63f-5c2cd992154f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:20.648676 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-408e287c-0518-44ed-a2bd-71372dfa8a44 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:20.659843 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-408e287c-0518-44ed-a2bd-71372dfa8a44 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1245 microversion: 2.1 time: 0.174045 Aug 18 11:03:20.661355 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 40/80] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:20 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1245 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:20.815700 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-467c6b9a-f6f3-4d9a-b63f-5c2cd992154f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:20.832441 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-467c6b9a-f6f3-4d9a-b63f-5c2cd992154f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.327411 Aug 18 11:03:20.838713 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 41/81] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:20 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:21.519706 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-50aebbcc-66aa-47c8-92da-09ef2d00cdc9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:21.521324 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:21.523413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:21.524468 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-50aebbcc-66aa-47c8-92da-09ef2d00cdc9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:21.538283 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=4 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:21.546840 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:21.547632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aebbcc-66aa-47c8-92da-09ef2d00cdc9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:21.548714 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aebbcc-66aa-47c8-92da-09ef2d00cdc9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:21.549445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:21.551730 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:21.551970 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aebbcc-66aa-47c8-92da-09ef2d00cdc9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:21.552918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aebbcc-66aa-47c8-92da-09ef2d00cdc9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:21.554290 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:21.554965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aebbcc-66aa-47c8-92da-09ef2d00cdc9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:21.556177 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aebbcc-66aa-47c8-92da-09ef2d00cdc9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:21.556452 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:21.557059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:22.117594 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:22.136487 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:22.139467 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:22.141880 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7f266033-f87f-43b3-a28f-5d00679338ce tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.639685 Aug 18 11:03:22.142944 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 42/82] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:21 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:22.150661 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-43bc63d1-aaa9-4c44-9598-12bccfd963f4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:22.151570 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-43bc63d1-aaa9-4c44-9598-12bccfd963f4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:22.168622 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-50aebbcc-66aa-47c8-92da-09ef2d00cdc9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:22.171223 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-43bc63d1-aaa9-4c44-9598-12bccfd963f4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:22.175073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-43bc63d1-aaa9-4c44-9598-12bccfd963f4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:22.179327 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-43bc63d1-aaa9-4c44-9598-12bccfd963f4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:22.180897 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-43bc63d1-aaa9-4c44-9598-12bccfd963f4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:22.181594 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-43bc63d1-aaa9-4c44-9598-12bccfd963f4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:22.182754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-43bc63d1-aaa9-4c44-9598-12bccfd963f4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:22.186183 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-50aebbcc-66aa-47c8-92da-09ef2d00cdc9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.678753 Aug 18 11:03:22.189063 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 41/83] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:21 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:22.205120 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-42f1f21e-00b7-43c3-8378-7aa6d6776184 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:22.206647 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-42f1f21e-00b7-43c3-8378-7aa6d6776184 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:22.231795 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-42f1f21e-00b7-43c3-8378-7aa6d6776184 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:22.233160 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-42f1f21e-00b7-43c3-8378-7aa6d6776184 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:22.234412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-42f1f21e-00b7-43c3-8378-7aa6d6776184 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:22.237190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-42f1f21e-00b7-43c3-8378-7aa6d6776184 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:22.238683 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-42f1f21e-00b7-43c3-8378-7aa6d6776184 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:22.240557 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-42f1f21e-00b7-43c3-8378-7aa6d6776184 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:22.344359 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-43bc63d1-aaa9-4c44-9598-12bccfd963f4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:22.355591 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-43bc63d1-aaa9-4c44-9598-12bccfd963f4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1311 microversion: 2.1 time: 0.209880 Aug 18 11:03:22.360868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 43/84] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:22 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:22.554657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-42f1f21e-00b7-43c3-8378-7aa6d6776184 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:22.565370 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-42f1f21e-00b7-43c3-8378-7aa6d6776184 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.373132 Aug 18 11:03:22.566677 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 42/85] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:22 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:22.637326 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-57114626-790b-46d6-82a3-60fb5a9b86ad req-b4bea452-d2b0-4a35-a4e7-ba3d67dc97e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e210ba46-e81e-4939-b202-4b569f906d8b", "tag": "850023d2-3a9f-4c57-85af-2b31e7f7b114"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:22.658756 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-57114626-790b-46d6-82a3-60fb5a9b86ad req-b4bea452-d2b0-4a35-a4e7-ba3d67dc97e4 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:22.661988 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-57114626-790b-46d6-82a3-60fb5a9b86ad req-b4bea452-d2b0-4a35-a4e7-ba3d67dc97e4 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:22.662692 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-57114626-790b-46d6-82a3-60fb5a9b86ad req-b4bea452-d2b0-4a35-a4e7-ba3d67dc97e4 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:22.697229 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-57114626-790b-46d6-82a3-60fb5a9b86ad req-b4bea452-d2b0-4a35-a4e7-ba3d67dc97e4 service nova] Creating event network-changed:850023d2-3a9f-4c57-85af-2b31e7f7b114 for instance e210ba46-e81e-4939-b202-4b569f906d8b on hv-cinder-82660 Aug 18 11:03:22.705969 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-57114626-790b-46d6-82a3-60fb5a9b86ad req-b4bea452-d2b0-4a35-a4e7-ba3d67dc97e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072907 Aug 18 11:03:22.707175 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 44/86] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:23.165877 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:23.166733 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:23.185499 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:23.186273 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:23.189887 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:23.195184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:23.197351 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:23.198484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:23.214570 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3701d798-33f8-4504-8abc-46f9921014c9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:23.215479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3701d798-33f8-4504-8abc-46f9921014c9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:23.226764 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3701d798-33f8-4504-8abc-46f9921014c9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:23.227799 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3701d798-33f8-4504-8abc-46f9921014c9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:23.228478 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3701d798-33f8-4504-8abc-46f9921014c9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:23.229433 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3701d798-33f8-4504-8abc-46f9921014c9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:23.230281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3701d798-33f8-4504-8abc-46f9921014c9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:23.230997 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3701d798-33f8-4504-8abc-46f9921014c9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:23.646849 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3701d798-33f8-4504-8abc-46f9921014c9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:23.653983 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:23.654551 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3701d798-33f8-4504-8abc-46f9921014c9 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.446480 Aug 18 11:03:23.672104 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:23.673436 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 45/87] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:23 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:23.689761 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fe098015-a307-47d6-a286-08d763813f22 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:23.690524 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fe098015-a307-47d6-a286-08d763813f22 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:23.699311 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe098015-a307-47d6-a286-08d763813f22 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:23.700122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe098015-a307-47d6-a286-08d763813f22 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:23.700954 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:23.706366 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe098015-a307-47d6-a286-08d763813f22 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:23.706679 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-cb6fdc1b-150f-4373-9e3a-88b54307ac72 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.545189 Aug 18 11:03:23.707479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe098015-a307-47d6-a286-08d763813f22 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:23.708142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe098015-a307-47d6-a286-08d763813f22 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:23.708714 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe098015-a307-47d6-a286-08d763813f22 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:23.712954 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 43/88] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:23 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:24.014882 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-9019ca26-f864-43ef-9ca2-b5fbe62754be req-a69beb7e-b926-48b1-99e0-ea15b557353f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf6cfd1-8e48-4e4e-9a3b-05363568e762", "name": "network-vif-plugged", "status": "completed", "tag": "c75ad995-e60d-4b15-bf38-31d1772db191"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:24.053409 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-9019ca26-f864-43ef-9ca2-b5fbe62754be req-a69beb7e-b926-48b1-99e0-ea15b557353f service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:24.054523 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-9019ca26-f864-43ef-9ca2-b5fbe62754be req-a69beb7e-b926-48b1-99e0-ea15b557353f service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:24.055182 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-9019ca26-f864-43ef-9ca2-b5fbe62754be req-a69beb7e-b926-48b1-99e0-ea15b557353f service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:24.107803 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-9019ca26-f864-43ef-9ca2-b5fbe62754be req-a69beb7e-b926-48b1-99e0-ea15b557353f service nova] Creating event network-vif-plugged:c75ad995-e60d-4b15-bf38-31d1772db191 for instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 on hv-cinder-82660 Aug 18 11:03:24.108530 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-9019ca26-f864-43ef-9ca2-b5fbe62754be req-a69beb7e-b926-48b1-99e0-ea15b557353f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:03:24.109127 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-9019ca26-f864-43ef-9ca2-b5fbe62754be req-a69beb7e-b926-48b1-99e0-ea15b557353f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:03:24.110525 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a17600bb-b6f4-4445-810e-e2073ea4658f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:24.111158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a17600bb-b6f4-4445-810e-e2073ea4658f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:24.112609 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a17600bb-b6f4-4445-810e-e2073ea4658f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:24.113716 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a17600bb-b6f4-4445-810e-e2073ea4658f None None] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:24.115193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a17600bb-b6f4-4445-810e-e2073ea4658f None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:24.116371 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a17600bb-b6f4-4445-810e-e2073ea4658f None None] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:24.129073 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.compute.rpcapi [None req-a17600bb-b6f4-4445-810e-e2073ea4658f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 11:03:24.147132 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a17600bb-b6f4-4445-810e-e2073ea4658f None None] Releasing lock "compute-rpcapi-router" {{(pid=120800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:03:24.194926 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a17600bb-b6f4-4445-810e-e2073ea4658f None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.480220 Aug 18 11:03:24.196327 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 44/89] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:24.205017 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-288136a1-a6b6-4f56-93c0-0114a9f4ff9a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:24.220841 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-288136a1-a6b6-4f56-93c0-0114a9f4ff9a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:24.244653 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-288136a1-a6b6-4f56-93c0-0114a9f4ff9a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:24.245205 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-288136a1-a6b6-4f56-93c0-0114a9f4ff9a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:24.245684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-288136a1-a6b6-4f56-93c0-0114a9f4ff9a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:24.246468 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-288136a1-a6b6-4f56-93c0-0114a9f4ff9a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:24.246932 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-288136a1-a6b6-4f56-93c0-0114a9f4ff9a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:24.248188 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-288136a1-a6b6-4f56-93c0-0114a9f4ff9a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:24.537225 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fe098015-a307-47d6-a286-08d763813f22 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:24.546458 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fe098015-a307-47d6-a286-08d763813f22 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.870868 Aug 18 11:03:24.547383 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 46/90] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:23 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:24.650050 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-288136a1-a6b6-4f56-93c0-0114a9f4ff9a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:24.662032 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-288136a1-a6b6-4f56-93c0-0114a9f4ff9a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.463347 Aug 18 11:03:24.667613 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 45/91] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:24 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:24.695613 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ccbc862d-cb0a-498b-8fcc-b73849ddb62d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:24.696397 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ccbc862d-cb0a-498b-8fcc-b73849ddb62d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:24.704094 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ccbc862d-cb0a-498b-8fcc-b73849ddb62d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:24.705125 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ccbc862d-cb0a-498b-8fcc-b73849ddb62d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:24.705700 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ccbc862d-cb0a-498b-8fcc-b73849ddb62d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:24.706528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ccbc862d-cb0a-498b-8fcc-b73849ddb62d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:24.707084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ccbc862d-cb0a-498b-8fcc-b73849ddb62d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:24.708398 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ccbc862d-cb0a-498b-8fcc-b73849ddb62d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:24.740846 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:24.741960 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:24.749418 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:24.750125 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:24.750818 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:24.751667 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:24.752262 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:24.752825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:24.997616 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:25.011260 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:25.013175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:25.014678 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-771a9297-39ae-4dc0-be1a-6e5547135ef2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.282638 Aug 18 11:03:25.016095 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 46/92] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:24 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:25.016558 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ccbc862d-cb0a-498b-8fcc-b73849ddb62d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:25.028210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ccbc862d-cb0a-498b-8fcc-b73849ddb62d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.351430 Aug 18 11:03:25.043387 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 47/93] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:24 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:25.199275 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-53b93abf-c7b1-4473-828f-3dba112934f2 req-8cad6f24-a72a-4d8e-99ff-fe393bf6d720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36caff1-93fb-4fd8-8727-9aa6b23ee576", "tag": "d14edd58-652d-4c9e-b988-a4e1b455c2b1"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:25.213047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-53b93abf-c7b1-4473-828f-3dba112934f2 req-8cad6f24-a72a-4d8e-99ff-fe393bf6d720 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:25.213047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-53b93abf-c7b1-4473-828f-3dba112934f2 req-8cad6f24-a72a-4d8e-99ff-fe393bf6d720 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:25.213047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-53b93abf-c7b1-4473-828f-3dba112934f2 req-8cad6f24-a72a-4d8e-99ff-fe393bf6d720 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:25.227815 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-53b93abf-c7b1-4473-828f-3dba112934f2 req-8cad6f24-a72a-4d8e-99ff-fe393bf6d720 service nova] Creating event network-changed:d14edd58-652d-4c9e-b988-a4e1b455c2b1 for instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 on hv-cinder-82660 Aug 18 11:03:25.233559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-53b93abf-c7b1-4473-828f-3dba112934f2 req-8cad6f24-a72a-4d8e-99ff-fe393bf6d720 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038813 Aug 18 11:03:25.234160 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 47/94] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:25.569882 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-db9b92fa-1a7b-42db-a6c8-18f05f69f24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:25.570767 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-db9b92fa-1a7b-42db-a6c8-18f05f69f24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:25.577356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db9b92fa-1a7b-42db-a6c8-18f05f69f24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:25.578061 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db9b92fa-1a7b-42db-a6c8-18f05f69f24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:25.578499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db9b92fa-1a7b-42db-a6c8-18f05f69f24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:25.579185 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db9b92fa-1a7b-42db-a6c8-18f05f69f24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:25.579639 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db9b92fa-1a7b-42db-a6c8-18f05f69f24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:25.580061 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db9b92fa-1a7b-42db-a6c8-18f05f69f24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:25.689143 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9960fc25-bf09-4c38-b69e-ed37be98a5b6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:25.690502 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9960fc25-bf09-4c38-b69e-ed37be98a5b6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:25.699838 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9960fc25-bf09-4c38-b69e-ed37be98a5b6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:25.700275 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9960fc25-bf09-4c38-b69e-ed37be98a5b6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:25.700815 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9960fc25-bf09-4c38-b69e-ed37be98a5b6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:25.701750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9960fc25-bf09-4c38-b69e-ed37be98a5b6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:25.702507 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9960fc25-bf09-4c38-b69e-ed37be98a5b6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:25.703080 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9960fc25-bf09-4c38-b69e-ed37be98a5b6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:25.759049 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-db9b92fa-1a7b-42db-a6c8-18f05f69f24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:25.764531 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-db9b92fa-1a7b-42db-a6c8-18f05f69f24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.200079 Aug 18 11:03:25.765002 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 48/95] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:25 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:25.926449 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9960fc25-bf09-4c38-b69e-ed37be98a5b6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:25.934722 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9960fc25-bf09-4c38-b69e-ed37be98a5b6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.250088 Aug 18 11:03:25.948375 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 48/96] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:25 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:26.042829 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:26.049340 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:26.055611 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4de13c68-3179-41e9-9ee0-39d474e39c3b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:26.056225 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4de13c68-3179-41e9-9ee0-39d474e39c3b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:26.060045 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:26.061083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:26.061943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:26.063228 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:26.063593 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4de13c68-3179-41e9-9ee0-39d474e39c3b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:26.064103 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4de13c68-3179-41e9-9ee0-39d474e39c3b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:26.064530 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4de13c68-3179-41e9-9ee0-39d474e39c3b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:26.064790 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:26.065190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4de13c68-3179-41e9-9ee0-39d474e39c3b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:26.065605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:26.065713 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4de13c68-3179-41e9-9ee0-39d474e39c3b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:26.066084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4de13c68-3179-41e9-9ee0-39d474e39c3b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:26.212668 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:26.226147 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4de13c68-3179-41e9-9ee0-39d474e39c3b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:26.229989 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:26.232210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:26.234088 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d971517a-1558-4cc5-9e90-96a6f84f2e93 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.195352 Aug 18 11:03:26.234956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 49/97] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:26 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:26.236400 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4de13c68-3179-41e9-9ee0-39d474e39c3b tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.184776 Aug 18 11:03:26.245445 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 49/98] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:26 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:26.250193 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-d1c36fb8-dbd9-4972-a81a-b057221d518f req-183f9981-aac6-4c98-85bc-113cbe5c562e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84d6955-9f03-4572-8bc7-afe5a9051ca2", "name": "network-vif-plugged", "status": "completed", "tag": "b889406a-fd6b-4f05-afb7-b8863a6cfc75"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:26.260889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-d1c36fb8-dbd9-4972-a81a-b057221d518f req-183f9981-aac6-4c98-85bc-113cbe5c562e service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:26.261364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-d1c36fb8-dbd9-4972-a81a-b057221d518f req-183f9981-aac6-4c98-85bc-113cbe5c562e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:26.261927 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-d1c36fb8-dbd9-4972-a81a-b057221d518f req-183f9981-aac6-4c98-85bc-113cbe5c562e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:26.276253 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-d1c36fb8-dbd9-4972-a81a-b057221d518f req-183f9981-aac6-4c98-85bc-113cbe5c562e service nova] Creating event network-vif-plugged:b889406a-fd6b-4f05-afb7-b8863a6cfc75 for instance b84d6955-9f03-4572-8bc7-afe5a9051ca2 on hv-cinder-82660 Aug 18 11:03:26.281889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-d1c36fb8-dbd9-4972-a81a-b057221d518f req-183f9981-aac6-4c98-85bc-113cbe5c562e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045148 Aug 18 11:03:26.282532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 50/99] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:26.789042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-925db3ae-0928-4c79-8a85-a83a86e75ff4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:26.789722 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-925db3ae-0928-4c79-8a85-a83a86e75ff4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:26.797029 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-925db3ae-0928-4c79-8a85-a83a86e75ff4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:26.797509 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-925db3ae-0928-4c79-8a85-a83a86e75ff4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:26.798139 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-925db3ae-0928-4c79-8a85-a83a86e75ff4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:26.799120 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-925db3ae-0928-4c79-8a85-a83a86e75ff4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:26.800014 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-925db3ae-0928-4c79-8a85-a83a86e75ff4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:26.800591 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-925db3ae-0928-4c79-8a85-a83a86e75ff4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:26.957029 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4b3636ee-fb6a-4a60-ab49-8e4a5da4a349 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:26.957792 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4b3636ee-fb6a-4a60-ab49-8e4a5da4a349 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:26.966259 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b3636ee-fb6a-4a60-ab49-8e4a5da4a349 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:26.966826 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b3636ee-fb6a-4a60-ab49-8e4a5da4a349 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:26.973147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b3636ee-fb6a-4a60-ab49-8e4a5da4a349 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:26.978965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b3636ee-fb6a-4a60-ab49-8e4a5da4a349 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:26.980096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b3636ee-fb6a-4a60-ab49-8e4a5da4a349 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:26.981707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b3636ee-fb6a-4a60-ab49-8e4a5da4a349 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:26.983461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-925db3ae-0928-4c79-8a85-a83a86e75ff4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:26.992633 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-925db3ae-0928-4c79-8a85-a83a86e75ff4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.209769 Aug 18 11:03:26.993252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 50/100] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:26 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:27.145634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4b3636ee-fb6a-4a60-ab49-8e4a5da4a349 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:27.153921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4b3636ee-fb6a-4a60-ab49-8e4a5da4a349 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.201620 Aug 18 11:03:27.154670 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 51/101] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:26 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:27.258720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5a65f1a3-276a-4559-aa5f-bc76eede5db5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:27.259328 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5a65f1a3-276a-4559-aa5f-bc76eede5db5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:27.261251 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=8 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:27.266373 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:27.266977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:27.275886 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5a65f1a3-276a-4559-aa5f-bc76eede5db5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:27.276378 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5a65f1a3-276a-4559-aa5f-bc76eede5db5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:27.276979 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5a65f1a3-276a-4559-aa5f-bc76eede5db5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:27.277926 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5a65f1a3-276a-4559-aa5f-bc76eede5db5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:27.278054 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:27.278730 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5a65f1a3-276a-4559-aa5f-bc76eede5db5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:27.279083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:27.279566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5a65f1a3-276a-4559-aa5f-bc76eede5db5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:27.279680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:27.280917 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:27.281700 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:27.282283 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:27.460157 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5a65f1a3-276a-4559-aa5f-bc76eede5db5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:27.472907 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:27.473688 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5a65f1a3-276a-4559-aa5f-bc76eede5db5 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.218864 Aug 18 11:03:27.474277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 51/102] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:27 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:27.499174 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:27.502000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:27.503449 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9fead3b9-3f9e-4dd9-b21c-7360314715db tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.240812 Aug 18 11:03:27.504176 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 52/103] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:27 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:28.013891 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3960c2da-5631-491e-ad1f-5754ecd422b9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:28.014343 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3960c2da-5631-491e-ad1f-5754ecd422b9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:28.029314 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3960c2da-5631-491e-ad1f-5754ecd422b9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:28.029837 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3960c2da-5631-491e-ad1f-5754ecd422b9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:28.030279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3960c2da-5631-491e-ad1f-5754ecd422b9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:28.031282 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3960c2da-5631-491e-ad1f-5754ecd422b9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:28.031742 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3960c2da-5631-491e-ad1f-5754ecd422b9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:28.032161 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3960c2da-5631-491e-ad1f-5754ecd422b9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:28.175656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-97f5e9f5-4bdd-47aa-8bbc-97c452136f8a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:28.177986 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-97f5e9f5-4bdd-47aa-8bbc-97c452136f8a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:28.189660 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-97f5e9f5-4bdd-47aa-8bbc-97c452136f8a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:28.194199 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-97f5e9f5-4bdd-47aa-8bbc-97c452136f8a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:28.194984 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-97f5e9f5-4bdd-47aa-8bbc-97c452136f8a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:28.198438 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-97f5e9f5-4bdd-47aa-8bbc-97c452136f8a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:28.201740 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-97f5e9f5-4bdd-47aa-8bbc-97c452136f8a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:28.202525 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-97f5e9f5-4bdd-47aa-8bbc-97c452136f8a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:28.516840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3960c2da-5631-491e-ad1f-5754ecd422b9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:28.526515 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3960c2da-5631-491e-ad1f-5754ecd422b9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.516414 Aug 18 11:03:28.527108 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 52/104] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:28 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:28.533463 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9e29bac4-d285-4303-8f28-ae980fb269a6 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:28.534275 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9e29bac4-d285-4303-8f28-ae980fb269a6 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:28.542854 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9e29bac4-d285-4303-8f28-ae980fb269a6 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:28.548721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9e29bac4-d285-4303-8f28-ae980fb269a6 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:28.548721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9e29bac4-d285-4303-8f28-ae980fb269a6 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:28.548721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9e29bac4-d285-4303-8f28-ae980fb269a6 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:28.548721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9e29bac4-d285-4303-8f28-ae980fb269a6 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:28.548989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9e29bac4-d285-4303-8f28-ae980fb269a6 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:28.721081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9e29bac4-d285-4303-8f28-ae980fb269a6 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:28.734511 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9e29bac4-d285-4303-8f28-ae980fb269a6 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.204705 Aug 18 11:03:28.735340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 53/105] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:28 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:28.743057 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:28.746396 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:28.754425 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:28.755769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:28.756727 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:28.757895 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:28.758427 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:28.758984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:28.777073 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=100 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:28.816339 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-97f5e9f5-4bdd-47aa-8bbc-97c452136f8a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:28.826548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-97f5e9f5-4bdd-47aa-8bbc-97c452136f8a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.654748 Aug 18 11:03:28.827560 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 53/106] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:28 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:28.966976 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:28.994153 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:28.997428 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:28.999951 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c494d9b6-06f3-4743-b63e-7c069c2f8f94 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.263437 Aug 18 11:03:29.003086 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 54/107] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:28 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:29.548809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4eae7729-f052-4ae4-add7-fc2a822d666d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:29.549868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4eae7729-f052-4ae4-add7-fc2a822d666d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:29.558149 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4eae7729-f052-4ae4-add7-fc2a822d666d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:29.558731 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4eae7729-f052-4ae4-add7-fc2a822d666d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:29.559238 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4eae7729-f052-4ae4-add7-fc2a822d666d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:29.560131 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4eae7729-f052-4ae4-add7-fc2a822d666d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:29.560774 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4eae7729-f052-4ae4-add7-fc2a822d666d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:29.561265 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4eae7729-f052-4ae4-add7-fc2a822d666d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:29.577868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=100 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:29.738909 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4eae7729-f052-4ae4-add7-fc2a822d666d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:29.750519 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4eae7729-f052-4ae4-add7-fc2a822d666d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.206006 Aug 18 11:03:29.759138 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-41ef837d-00df-4ebb-bc6d-8e2393630803 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:29.759758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-41ef837d-00df-4ebb-bc6d-8e2393630803 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:29.772688 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 54/108] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:29 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:29.774003 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41ef837d-00df-4ebb-bc6d-8e2393630803 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:29.774668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41ef837d-00df-4ebb-bc6d-8e2393630803 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:29.775447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41ef837d-00df-4ebb-bc6d-8e2393630803 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:29.776638 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41ef837d-00df-4ebb-bc6d-8e2393630803 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:29.777148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41ef837d-00df-4ebb-bc6d-8e2393630803 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:29.777990 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41ef837d-00df-4ebb-bc6d-8e2393630803 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:29.848000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d11a0df9-8104-41c5-bf42-e47f4b37a1f9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:29.849277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d11a0df9-8104-41c5-bf42-e47f4b37a1f9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:29.856738 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d11a0df9-8104-41c5-bf42-e47f4b37a1f9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:29.857301 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d11a0df9-8104-41c5-bf42-e47f4b37a1f9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:29.858112 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d11a0df9-8104-41c5-bf42-e47f4b37a1f9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:29.859320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d11a0df9-8104-41c5-bf42-e47f4b37a1f9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:29.860092 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d11a0df9-8104-41c5-bf42-e47f4b37a1f9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:29.860847 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d11a0df9-8104-41c5-bf42-e47f4b37a1f9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:30.030788 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-41ef837d-00df-4ebb-bc6d-8e2393630803 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:30.052881 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-41ef837d-00df-4ebb-bc6d-8e2393630803 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.298551 Aug 18 11:03:30.055987 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 55/109] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:29 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:30.074617 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:30.076734 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:30.094190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:30.095308 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:30.097245 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:30.098190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:30.100198 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:30.100956 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:30.107625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d11a0df9-8104-41c5-bf42-e47f4b37a1f9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:30.121775 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d11a0df9-8104-41c5-bf42-e47f4b37a1f9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.277353 Aug 18 11:03:30.137370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 55/110] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:29 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:30.186481 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-f0af3f06-d31c-4d72-8639-49dbb4950f79 req-52c4f2fa-892d-4ab1-8988-b4af66a006ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a38c9ed-092c-4a82-9581-85326a84f582", "name": "network-vif-plugged", "status": "completed", "tag": "4bed2960-285e-436c-92c4-807908aec234"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:30.228531 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-f0af3f06-d31c-4d72-8639-49dbb4950f79 req-52c4f2fa-892d-4ab1-8988-b4af66a006ec service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:30.231279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-f0af3f06-d31c-4d72-8639-49dbb4950f79 req-52c4f2fa-892d-4ab1-8988-b4af66a006ec service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:30.234805 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-f0af3f06-d31c-4d72-8639-49dbb4950f79 req-52c4f2fa-892d-4ab1-8988-b4af66a006ec service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:30.283481 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-f0af3f06-d31c-4d72-8639-49dbb4950f79 req-52c4f2fa-892d-4ab1-8988-b4af66a006ec service nova] Creating event network-vif-plugged:4bed2960-285e-436c-92c4-807908aec234 for instance 9a38c9ed-092c-4a82-9581-85326a84f582 on hv-cinder-82660 Aug 18 11:03:30.298352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-f0af3f06-d31c-4d72-8639-49dbb4950f79 req-52c4f2fa-892d-4ab1-8988-b4af66a006ec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110679 Aug 18 11:03:30.298352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 56/111] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:03:30.393058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:30.403896 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:30.406948 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:30.408495 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-acb7eaa7-5767-4562-9d54-1960fd5b051f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.349936 Aug 18 11:03:30.410060 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 56/112] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:30 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:30.776383 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d319a026-c2a0-478d-be82-796926e063ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:30.777073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d319a026-c2a0-478d-be82-796926e063ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:30.783801 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d319a026-c2a0-478d-be82-796926e063ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:30.784387 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d319a026-c2a0-478d-be82-796926e063ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:30.784965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d319a026-c2a0-478d-be82-796926e063ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:30.785737 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d319a026-c2a0-478d-be82-796926e063ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:30.786846 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d319a026-c2a0-478d-be82-796926e063ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:30.787487 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d319a026-c2a0-478d-be82-796926e063ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:30.993843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d319a026-c2a0-478d-be82-796926e063ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:31.002103 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d319a026-c2a0-478d-be82-796926e063ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.230056 Aug 18 11:03:31.002883 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 57/113] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:30 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:31.079008 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1bc204be-d396-42a2-bb3e-313d9994ca54 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:31.083548 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1bc204be-d396-42a2-bb3e-313d9994ca54 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:31.090252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1bc204be-d396-42a2-bb3e-313d9994ca54 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:31.091015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1bc204be-d396-42a2-bb3e-313d9994ca54 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:31.091645 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1bc204be-d396-42a2-bb3e-313d9994ca54 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:31.092346 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1bc204be-d396-42a2-bb3e-313d9994ca54 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:31.092800 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1bc204be-d396-42a2-bb3e-313d9994ca54 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:31.093222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1bc204be-d396-42a2-bb3e-313d9994ca54 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:31.150457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e420f6d7-ee5c-485e-bacf-855daf1dc278 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:31.151640 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e420f6d7-ee5c-485e-bacf-855daf1dc278 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:31.161274 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e420f6d7-ee5c-485e-bacf-855daf1dc278 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:31.162292 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e420f6d7-ee5c-485e-bacf-855daf1dc278 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:31.163035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e420f6d7-ee5c-485e-bacf-855daf1dc278 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:31.164494 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e420f6d7-ee5c-485e-bacf-855daf1dc278 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:31.165426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e420f6d7-ee5c-485e-bacf-855daf1dc278 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:31.166188 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e420f6d7-ee5c-485e-bacf-855daf1dc278 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:31.255989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1bc204be-d396-42a2-bb3e-313d9994ca54 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:31.263849 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1bc204be-d396-42a2-bb3e-313d9994ca54 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.188612 Aug 18 11:03:31.264420 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 57/114] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:31 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:31.346451 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e420f6d7-ee5c-485e-bacf-855daf1dc278 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:31.359980 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e420f6d7-ee5c-485e-bacf-855daf1dc278 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.219181 Aug 18 11:03:31.369987 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 58/115] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:31 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:31.438907 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:31.439534 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:31.456905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:31.457471 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:31.458359 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:31.459098 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:31.459557 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:31.459981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:31.661698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:31.673569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:31.676012 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:31.678995 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6a48cc8c-bb1a-4344-8291-17837285dbfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.251054 Aug 18 11:03:31.679841 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 58/116] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:31 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:32.024843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-026ee45c-1c91-48fb-b082-cb6789c8f1c3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:32.026273 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-026ee45c-1c91-48fb-b082-cb6789c8f1c3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:32.032449 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-026ee45c-1c91-48fb-b082-cb6789c8f1c3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:32.032933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-026ee45c-1c91-48fb-b082-cb6789c8f1c3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:32.033370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-026ee45c-1c91-48fb-b082-cb6789c8f1c3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:32.034106 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-026ee45c-1c91-48fb-b082-cb6789c8f1c3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:32.034542 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-026ee45c-1c91-48fb-b082-cb6789c8f1c3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:32.035119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-026ee45c-1c91-48fb-b082-cb6789c8f1c3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:32.219217 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-026ee45c-1c91-48fb-b082-cb6789c8f1c3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:32.229668 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-026ee45c-1c91-48fb-b082-cb6789c8f1c3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.209812 Aug 18 11:03:32.246207 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 59/117] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:32 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:32.287308 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9bae31b3-5b28-46b3-99fa-033b0b78c196 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:32.288073 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9bae31b3-5b28-46b3-99fa-033b0b78c196 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:32.295407 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9bae31b3-5b28-46b3-99fa-033b0b78c196 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:32.296255 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9bae31b3-5b28-46b3-99fa-033b0b78c196 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:32.296651 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9bae31b3-5b28-46b3-99fa-033b0b78c196 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:32.297444 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9bae31b3-5b28-46b3-99fa-033b0b78c196 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:32.297942 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9bae31b3-5b28-46b3-99fa-033b0b78c196 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:32.298367 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9bae31b3-5b28-46b3-99fa-033b0b78c196 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:32.385621 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5b3efe63-c73e-4483-b355-2e7d2fd8bfda tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:32.386264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5b3efe63-c73e-4483-b355-2e7d2fd8bfda tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:32.396224 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b3efe63-c73e-4483-b355-2e7d2fd8bfda tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:32.396727 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b3efe63-c73e-4483-b355-2e7d2fd8bfda tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:32.397165 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b3efe63-c73e-4483-b355-2e7d2fd8bfda tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:32.399730 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b3efe63-c73e-4483-b355-2e7d2fd8bfda tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:32.400375 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b3efe63-c73e-4483-b355-2e7d2fd8bfda tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:32.401254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b3efe63-c73e-4483-b355-2e7d2fd8bfda tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:32.712633 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5b3efe63-c73e-4483-b355-2e7d2fd8bfda tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:32.725202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5b3efe63-c73e-4483-b355-2e7d2fd8bfda tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.344496 Aug 18 11:03:32.729993 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 60/118] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:32 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:32.737590 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:32.739161 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:32.757541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:32.763301 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:32.764124 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:32.765381 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:32.766178 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:32.766629 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:32.887457 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9bae31b3-5b28-46b3-99fa-033b0b78c196 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:32.899777 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9bae31b3-5b28-46b3-99fa-033b0b78c196 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.616384 Aug 18 11:03:32.902167 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 59/119] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:32 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:32.949084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:32.959355 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:32.961093 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:32.963293 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ac5881dd-cf7d-4418-9268-3317a6c7059e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.232007 Aug 18 11:03:32.963998 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 61/120] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:32 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:33.255974 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0d12b03e-b2b4-41f9-b387-a02a685627e3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:33.257309 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0d12b03e-b2b4-41f9-b387-a02a685627e3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:33.265356 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d12b03e-b2b4-41f9-b387-a02a685627e3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:33.266129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d12b03e-b2b4-41f9-b387-a02a685627e3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:33.267447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d12b03e-b2b4-41f9-b387-a02a685627e3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:33.268615 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d12b03e-b2b4-41f9-b387-a02a685627e3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:33.269207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d12b03e-b2b4-41f9-b387-a02a685627e3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:33.269909 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d12b03e-b2b4-41f9-b387-a02a685627e3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:33.405671 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-c51211e4-e38c-4d6c-8eaa-6c72c812af65 req-e3c299b1-8385-4a45-b127-25e8d0207fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e210ba46-e81e-4939-b202-4b569f906d8b", "name": "network-vif-plugged", "status": "completed", "tag": "850023d2-3a9f-4c57-85af-2b31e7f7b114"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:33.421410 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-c51211e4-e38c-4d6c-8eaa-6c72c812af65 req-e3c299b1-8385-4a45-b127-25e8d0207fd5 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:33.422976 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-c51211e4-e38c-4d6c-8eaa-6c72c812af65 req-e3c299b1-8385-4a45-b127-25e8d0207fd5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:33.423771 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-c51211e4-e38c-4d6c-8eaa-6c72c812af65 req-e3c299b1-8385-4a45-b127-25e8d0207fd5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:33.427765 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0d12b03e-b2b4-41f9-b387-a02a685627e3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:33.436993 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0d12b03e-b2b4-41f9-b387-a02a685627e3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.187601 Aug 18 11:03:33.439435 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 60/121] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:33 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:33.451156 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-c51211e4-e38c-4d6c-8eaa-6c72c812af65 req-e3c299b1-8385-4a45-b127-25e8d0207fd5 service nova] Creating event network-vif-plugged:850023d2-3a9f-4c57-85af-2b31e7f7b114 for instance e210ba46-e81e-4939-b202-4b569f906d8b on hv-cinder-82660 Aug 18 11:03:33.459729 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-c51211e4-e38c-4d6c-8eaa-6c72c812af65 req-e3c299b1-8385-4a45-b127-25e8d0207fd5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063518 Aug 18 11:03:33.460864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 62/122] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:33.747621 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6bbfede1-4c05-4a25-b7c4-80fc2951566c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:33.748581 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6bbfede1-4c05-4a25-b7c4-80fc2951566c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:33.760275 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bbfede1-4c05-4a25-b7c4-80fc2951566c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:33.760789 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bbfede1-4c05-4a25-b7c4-80fc2951566c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:33.761288 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bbfede1-4c05-4a25-b7c4-80fc2951566c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:33.762130 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bbfede1-4c05-4a25-b7c4-80fc2951566c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:33.762601 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bbfede1-4c05-4a25-b7c4-80fc2951566c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:33.763028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bbfede1-4c05-4a25-b7c4-80fc2951566c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:33.917473 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6bbfede1-4c05-4a25-b7c4-80fc2951566c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:33.924120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-356d8639-bcfd-4560-8219-d7a8dc819e69 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:33.924822 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-356d8639-bcfd-4560-8219-d7a8dc819e69 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:33.926886 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6bbfede1-4c05-4a25-b7c4-80fc2951566c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1322 microversion: 2.1 time: 0.183200 Aug 18 11:03:33.928219 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 61/123] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:33 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:33.933233 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-356d8639-bcfd-4560-8219-d7a8dc819e69 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:33.934077 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-356d8639-bcfd-4560-8219-d7a8dc819e69 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:33.934249 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-356d8639-bcfd-4560-8219-d7a8dc819e69 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:33.934985 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-356d8639-bcfd-4560-8219-d7a8dc819e69 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:33.935358 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-356d8639-bcfd-4560-8219-d7a8dc819e69 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:33.935914 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-356d8639-bcfd-4560-8219-d7a8dc819e69 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:33.987377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:33.988190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:33.995753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:33.996314 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:33.996819 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:33.997613 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:33.998137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:33.998647 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:34.114959 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-356d8639-bcfd-4560-8219-d7a8dc819e69 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:34.125786 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-356d8639-bcfd-4560-8219-d7a8dc819e69 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.203354 Aug 18 11:03:34.125786 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 63/124] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:33 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:34.128385 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=4 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:34.167463 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:34.182364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:34.183860 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:34.184971 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c8f73dee-d88b-4adb-827c-0011c2a36a6f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.201698 Aug 18 11:03:34.185545 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 62/125] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:33 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:34.459301 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-48fd8d0f-7a65-4b2f-94ae-fbe662b0ba52 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:34.459947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-48fd8d0f-7a65-4b2f-94ae-fbe662b0ba52 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:34.466955 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-48fd8d0f-7a65-4b2f-94ae-fbe662b0ba52 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:34.467437 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-48fd8d0f-7a65-4b2f-94ae-fbe662b0ba52 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:34.467868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-48fd8d0f-7a65-4b2f-94ae-fbe662b0ba52 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:34.468556 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-48fd8d0f-7a65-4b2f-94ae-fbe662b0ba52 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:34.468999 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-48fd8d0f-7a65-4b2f-94ae-fbe662b0ba52 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:34.469413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-48fd8d0f-7a65-4b2f-94ae-fbe662b0ba52 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:34.634087 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-48fd8d0f-7a65-4b2f-94ae-fbe662b0ba52 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:34.641931 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-48fd8d0f-7a65-4b2f-94ae-fbe662b0ba52 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.186449 Aug 18 11:03:34.642505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 64/126] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:34 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:34.953228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-63b543f7-f348-44d3-aa7c-f13390176e44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:34.953985 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-63b543f7-f348-44d3-aa7c-f13390176e44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:34.961683 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63b543f7-f348-44d3-aa7c-f13390176e44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:34.962402 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63b543f7-f348-44d3-aa7c-f13390176e44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:34.962990 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63b543f7-f348-44d3-aa7c-f13390176e44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:34.963701 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63b543f7-f348-44d3-aa7c-f13390176e44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:34.964318 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63b543f7-f348-44d3-aa7c-f13390176e44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:34.964748 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63b543f7-f348-44d3-aa7c-f13390176e44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:35.129310 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-63b543f7-f348-44d3-aa7c-f13390176e44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:35.138288 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-63b543f7-f348-44d3-aa7c-f13390176e44 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1516 microversion: 2.1 time: 0.189892 Aug 18 11:03:35.139372 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 63/127] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:34 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:35.148647 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-893a81a6-1393-4408-91ae-63056b081725 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:35.149321 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-893a81a6-1393-4408-91ae-63056b081725 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:35.158944 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-893a81a6-1393-4408-91ae-63056b081725 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:35.159557 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-893a81a6-1393-4408-91ae-63056b081725 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:35.159962 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-893a81a6-1393-4408-91ae-63056b081725 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:35.160669 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-893a81a6-1393-4408-91ae-63056b081725 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:35.162070 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-893a81a6-1393-4408-91ae-63056b081725 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:35.162755 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-893a81a6-1393-4408-91ae-63056b081725 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:35.163255 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e809260f-7f20-4ba7-95ab-d02cbe7910de tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:35.166100 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e809260f-7f20-4ba7-95ab-d02cbe7910de tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:35.173362 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e809260f-7f20-4ba7-95ab-d02cbe7910de tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:35.174117 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e809260f-7f20-4ba7-95ab-d02cbe7910de tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:35.175200 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e809260f-7f20-4ba7-95ab-d02cbe7910de tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:35.176111 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e809260f-7f20-4ba7-95ab-d02cbe7910de tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:35.177109 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e809260f-7f20-4ba7-95ab-d02cbe7910de tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:35.177880 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e809260f-7f20-4ba7-95ab-d02cbe7910de tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:35.256775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-e809260f-7f20-4ba7-95ab-d02cbe7910de tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lazy-loading 'flavor' on Instance uuid b84d6955-9f03-4572-8bc7-afe5a9051ca2 {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:03:35.400804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e809260f-7f20-4ba7-95ab-d02cbe7910de tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2/action" status: 200 len: 32 microversion: 2.1 time: 0.243435 Aug 18 11:03:35.400804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 64/128] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:03:35 2022] POST /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:03:35.406594 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:35.407883 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:35.421190 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-893a81a6-1393-4408-91ae-63056b081725 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:35.424166 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:35.424676 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:35.425140 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:35.426118 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:35.428108 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:35.428734 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:35.435896 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-893a81a6-1393-4408-91ae-63056b081725 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.293697 Aug 18 11:03:35.437075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 65/129] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:35 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:35.442163 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5c31d4b6-4f0f-403c-8ba1-8b22a56b33d5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:35.443098 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5c31d4b6-4f0f-403c-8ba1-8b22a56b33d5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:35.449537 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c31d4b6-4f0f-403c-8ba1-8b22a56b33d5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:35.450279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c31d4b6-4f0f-403c-8ba1-8b22a56b33d5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:35.450717 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c31d4b6-4f0f-403c-8ba1-8b22a56b33d5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:35.451407 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c31d4b6-4f0f-403c-8ba1-8b22a56b33d5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:35.451860 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c31d4b6-4f0f-403c-8ba1-8b22a56b33d5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:35.452280 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c31d4b6-4f0f-403c-8ba1-8b22a56b33d5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:35.793854 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:35.806515 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:35.808779 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:35.810424 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0d2de99f-718a-4743-b061-8ce264c68404 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.407895 Aug 18 11:03:35.811229 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 65/130] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:35 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:35.821813 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5c31d4b6-4f0f-403c-8ba1-8b22a56b33d5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:35.822324 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5c31d4b6-4f0f-403c-8ba1-8b22a56b33d5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.383912 Aug 18 11:03:35.822906 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 66/131] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:35 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:35.833131 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b651ab8c-d7ec-4a02-b4c3-9b44074d0a05 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:35.834058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b651ab8c-d7ec-4a02-b4c3-9b44074d0a05 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:35.841341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b651ab8c-d7ec-4a02-b4c3-9b44074d0a05 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:35.841857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b651ab8c-d7ec-4a02-b4c3-9b44074d0a05 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:35.842405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b651ab8c-d7ec-4a02-b4c3-9b44074d0a05 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:35.843503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b651ab8c-d7ec-4a02-b4c3-9b44074d0a05 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:35.843955 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b651ab8c-d7ec-4a02-b4c3-9b44074d0a05 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:35.844376 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b651ab8c-d7ec-4a02-b4c3-9b44074d0a05 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:36.081999 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b651ab8c-d7ec-4a02-b4c3-9b44074d0a05 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:36.090448 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b651ab8c-d7ec-4a02-b4c3-9b44074d0a05 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.266293 Aug 18 11:03:36.091437 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 66/132] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:35 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:36.459735 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-dbc83020-cbd3-45bb-a704-ffb6792f5f56 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:36.460540 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-dbc83020-cbd3-45bb-a704-ffb6792f5f56 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:36.466835 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dbc83020-cbd3-45bb-a704-ffb6792f5f56 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:36.467314 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dbc83020-cbd3-45bb-a704-ffb6792f5f56 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:36.467745 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dbc83020-cbd3-45bb-a704-ffb6792f5f56 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:36.468436 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dbc83020-cbd3-45bb-a704-ffb6792f5f56 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:36.468888 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dbc83020-cbd3-45bb-a704-ffb6792f5f56 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:36.469307 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dbc83020-cbd3-45bb-a704-ffb6792f5f56 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:36.677715 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-dbc83020-cbd3-45bb-a704-ffb6792f5f56 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:36.688718 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-dbc83020-cbd3-45bb-a704-ffb6792f5f56 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.233017 Aug 18 11:03:36.709783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 67/133] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:36 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:36.837161 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:36.837907 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:36.846235 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-baf58fef-76d8-4081-8b9f-dc8b205f5c9e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:36.847755 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-baf58fef-76d8-4081-8b9f-dc8b205f5c9e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:36.849893 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:36.850427 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:36.850954 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:36.851718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:36.852225 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:36.852690 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:36.856402 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-baf58fef-76d8-4081-8b9f-dc8b205f5c9e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:36.856970 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-baf58fef-76d8-4081-8b9f-dc8b205f5c9e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:36.857631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-baf58fef-76d8-4081-8b9f-dc8b205f5c9e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:36.858557 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-baf58fef-76d8-4081-8b9f-dc8b205f5c9e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:36.859174 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-baf58fef-76d8-4081-8b9f-dc8b205f5c9e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:36.859741 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-baf58fef-76d8-4081-8b9f-dc8b205f5c9e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:37.017453 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:37.022540 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-baf58fef-76d8-4081-8b9f-dc8b205f5c9e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:37.029213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:37.030264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-baf58fef-76d8-4081-8b9f-dc8b205f5c9e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.189861 Aug 18 11:03:37.030962 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 68/134] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:36 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:37.044405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:37.044405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8db37c37-2ec6-428a-9eba-3d825456092d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.200403 Aug 18 11:03:37.044405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 67/135] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:36 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:37.115845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-074f3f4d-7fab-406b-95aa-9d9f8f075022 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:37.116485 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-074f3f4d-7fab-406b-95aa-9d9f8f075022 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:37.122541 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-074f3f4d-7fab-406b-95aa-9d9f8f075022 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:37.123027 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-074f3f4d-7fab-406b-95aa-9d9f8f075022 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:37.123461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-074f3f4d-7fab-406b-95aa-9d9f8f075022 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:37.124159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-074f3f4d-7fab-406b-95aa-9d9f8f075022 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:37.124611 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-074f3f4d-7fab-406b-95aa-9d9f8f075022 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:37.125035 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-074f3f4d-7fab-406b-95aa-9d9f8f075022 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:37.271185 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-074f3f4d-7fab-406b-95aa-9d9f8f075022 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:37.279381 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-074f3f4d-7fab-406b-95aa-9d9f8f075022 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.168039 Aug 18 11:03:37.279962 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 68/136] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:37 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:37.713994 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fe7abb16-5073-4f2f-a9b5-cb221c01c65e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:37.714804 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fe7abb16-5073-4f2f-a9b5-cb221c01c65e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:37.721729 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe7abb16-5073-4f2f-a9b5-cb221c01c65e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:37.722218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe7abb16-5073-4f2f-a9b5-cb221c01c65e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:37.722655 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe7abb16-5073-4f2f-a9b5-cb221c01c65e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:37.724056 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe7abb16-5073-4f2f-a9b5-cb221c01c65e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:37.724580 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe7abb16-5073-4f2f-a9b5-cb221c01c65e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:37.725305 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe7abb16-5073-4f2f-a9b5-cb221c01c65e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:37.867567 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fe7abb16-5073-4f2f-a9b5-cb221c01c65e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:37.876447 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fe7abb16-5073-4f2f-a9b5-cb221c01c65e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1315 microversion: 2.1 time: 0.166858 Aug 18 11:03:37.877584 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 69/137] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:37 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:38.054649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-63cc6f1f-785d-48d2-aa05-6a5ab929f4be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:38.055184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-63cc6f1f-785d-48d2-aa05-6a5ab929f4be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:38.058831 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:38.059757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:38.061826 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63cc6f1f-785d-48d2-aa05-6a5ab929f4be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:38.062394 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63cc6f1f-785d-48d2-aa05-6a5ab929f4be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:38.064501 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63cc6f1f-785d-48d2-aa05-6a5ab929f4be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:38.065398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63cc6f1f-785d-48d2-aa05-6a5ab929f4be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:38.065840 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:38.065959 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63cc6f1f-785d-48d2-aa05-6a5ab929f4be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:38.066328 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:38.066441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-63cc6f1f-785d-48d2-aa05-6a5ab929f4be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:38.066764 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:38.068358 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:38.068798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:38.069464 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:38.071372 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:38.219471 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-63cc6f1f-785d-48d2-aa05-6a5ab929f4be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:38.228203 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-63cc6f1f-785d-48d2-aa05-6a5ab929f4be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.179680 Aug 18 11:03:38.228552 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:38.228790 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 69/138] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:38 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:38.237166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:38.238706 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:38.239846 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b0665781-838c-4b26-a405-f88f78f6258e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.186653 Aug 18 11:03:38.240391 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 70/139] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:38 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:38.302152 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-29c1a861-65dd-482f-92f2-28cd4ac7f9c2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:38.302736 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-29c1a861-65dd-482f-92f2-28cd4ac7f9c2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:38.311077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-29c1a861-65dd-482f-92f2-28cd4ac7f9c2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:38.311779 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-29c1a861-65dd-482f-92f2-28cd4ac7f9c2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:38.312482 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-29c1a861-65dd-482f-92f2-28cd4ac7f9c2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:38.313196 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-29c1a861-65dd-482f-92f2-28cd4ac7f9c2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:38.313735 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-29c1a861-65dd-482f-92f2-28cd4ac7f9c2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:38.314140 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-29c1a861-65dd-482f-92f2-28cd4ac7f9c2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:38.475744 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-29c1a861-65dd-482f-92f2-28cd4ac7f9c2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:38.485131 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-29c1a861-65dd-482f-92f2-28cd4ac7f9c2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.187139 Aug 18 11:03:38.485748 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 70/140] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:38 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:38.899970 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ce8d916c-0cbb-4d42-93a5-6f8db8a95b14 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:38.899970 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ce8d916c-0cbb-4d42-93a5-6f8db8a95b14 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:38.906075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce8d916c-0cbb-4d42-93a5-6f8db8a95b14 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:38.906564 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce8d916c-0cbb-4d42-93a5-6f8db8a95b14 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:38.906998 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce8d916c-0cbb-4d42-93a5-6f8db8a95b14 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:38.907697 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce8d916c-0cbb-4d42-93a5-6f8db8a95b14 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:38.908149 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce8d916c-0cbb-4d42-93a5-6f8db8a95b14 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:38.909363 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce8d916c-0cbb-4d42-93a5-6f8db8a95b14 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:39.024795 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-883039052", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "networks": [{"uuid": "930e3c79-4766-4aeb-a65f-466e9f963721"}]}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:39.092373 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ce8d916c-0cbb-4d42-93a5-6f8db8a95b14 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:39.103767 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ce8d916c-0cbb-4d42-93a5-6f8db8a95b14 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1502 microversion: 2.1 time: 0.206695 Aug 18 11:03:39.104639 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 71/141] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:38 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:39.119245 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.network.neutron [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] validate_networks() for [('930e3c79-4766-4aeb-a65f-466e9f963721', None, None, None, None, None)] {{(pid=120800) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:03:39.251652 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6c4cc24f-24b7-4519-85aa-91dcfc6c3fe1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:39.253253 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6c4cc24f-24b7-4519-85aa-91dcfc6c3fe1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:39.267037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c4cc24f-24b7-4519-85aa-91dcfc6c3fe1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:39.267742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c4cc24f-24b7-4519-85aa-91dcfc6c3fe1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:39.268417 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c4cc24f-24b7-4519-85aa-91dcfc6c3fe1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:39.269315 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c4cc24f-24b7-4519-85aa-91dcfc6c3fe1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:39.270275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c4cc24f-24b7-4519-85aa-91dcfc6c3fe1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:39.270809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c4cc24f-24b7-4519-85aa-91dcfc6c3fe1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:39.297301 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=100 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:39.560576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6c4cc24f-24b7-4519-85aa-91dcfc6c3fe1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:39.573639 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6c4cc24f-24b7-4519-85aa-91dcfc6c3fe1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.323555 Aug 18 11:03:39.574277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 72/142] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:39 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:39.590609 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:39.592608 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:39.613948 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:39.619251 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:39.619251 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:39.624031 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:39.625400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:39.628519 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:39.674929 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Flavor limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:03:39.675449 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Image limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:03:39.675786 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Flavor pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:03:39.676183 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Image pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:03:39.677511 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:03:39.696467 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:39.696957 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:39.697391 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:39.698314 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:39.698775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:39.699201 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:39.719905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Getting quotas for project d591dc6849c641888dbd28827a629d31. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:03:39.725345 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Getting quotas for user 2ea5b4501d934e1bbfd6d46577d09e5d and project d591dc6849c641888dbd28827a629d31. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:03:39.741227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Going to run 1 instances... {{(pid=120800) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:03:39.745121 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:03:39.795796 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7b35d354-3172-4166-b3a9-b8fc6fb2d328 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777715 Aug 18 11:03:39.797390 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 71/143] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:03:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:03:39.803132 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b643eb23-0f29-4923-9794-1991c7893db3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:39.804339 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b643eb23-0f29-4923-9794-1991c7893db3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:39.810781 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b643eb23-0f29-4923-9794-1991c7893db3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:39.811565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b643eb23-0f29-4923-9794-1991c7893db3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:39.812170 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b643eb23-0f29-4923-9794-1991c7893db3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:39.812864 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b643eb23-0f29-4923-9794-1991c7893db3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:39.813467 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b643eb23-0f29-4923-9794-1991c7893db3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:39.814101 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b643eb23-0f29-4923-9794-1991c7893db3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:39.832722 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:39.843961 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:39.851400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:39.852572 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7bbf6961-246e-41e2-9418-e70998035d4a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.277195 Aug 18 11:03:39.853162 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 73/144] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:39 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:39.857735 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-df6f404b-7bd0-4d65-bb14-9e73f7060c51 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:39.858528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-df6f404b-7bd0-4d65-bb14-9e73f7060c51 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:39.934714 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-df6f404b-7bd0-4d65-bb14-9e73f7060c51 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:39.946189 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-df6f404b-7bd0-4d65-bb14-9e73f7060c51 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1213 microversion: 2.1 time: 0.091754 Aug 18 11:03:39.946779 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 74/145] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:39 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:39.980320 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b643eb23-0f29-4923-9794-1991c7893db3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:39.989438 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b643eb23-0f29-4923-9794-1991c7893db3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.190610 Aug 18 11:03:39.990067 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 72/146] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:39 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:40.600120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0b954e96-9cb5-4edc-bd81-d5de11571e05 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:40.601021 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0b954e96-9cb5-4edc-bd81-d5de11571e05 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:40.608507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b954e96-9cb5-4edc-bd81-d5de11571e05 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:40.609279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b954e96-9cb5-4edc-bd81-d5de11571e05 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:40.609850 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b954e96-9cb5-4edc-bd81-d5de11571e05 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:40.610687 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b954e96-9cb5-4edc-bd81-d5de11571e05 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:40.611285 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b954e96-9cb5-4edc-bd81-d5de11571e05 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:40.611815 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b954e96-9cb5-4edc-bd81-d5de11571e05 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:40.750194 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0b954e96-9cb5-4edc-bd81-d5de11571e05 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:40.758285 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0b954e96-9cb5-4edc-bd81-d5de11571e05 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.162916 Aug 18 11:03:40.758785 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 75/147] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:40 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:40.875673 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:40.876480 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:40.884580 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:40.885068 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:40.885501 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:40.886219 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:40.886674 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:40.887093 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:40.968218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-14005857-1884-4f2c-81b9-1c066c7be0ab tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:40.968907 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-14005857-1884-4f2c-81b9-1c066c7be0ab tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:40.975803 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14005857-1884-4f2c-81b9-1c066c7be0ab tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:40.976375 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14005857-1884-4f2c-81b9-1c066c7be0ab tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:40.976883 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14005857-1884-4f2c-81b9-1c066c7be0ab tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:40.977684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14005857-1884-4f2c-81b9-1c066c7be0ab tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:40.978215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14005857-1884-4f2c-81b9-1c066c7be0ab tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:40.978645 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14005857-1884-4f2c-81b9-1c066c7be0ab tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:41.018629 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:41.027739 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:41.029193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:41.030366 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9cb49929-0ac7-4e87-8ba3-cce788b4bf90 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.158579 Aug 18 11:03:41.030961 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 73/148] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:40 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:41.040637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b5f674b2-9b92-413b-8e5f-644aa0aa0951 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:41.040637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b5f674b2-9b92-413b-8e5f-644aa0aa0951 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:41.042397 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5f674b2-9b92-413b-8e5f-644aa0aa0951 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:41.042889 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5f674b2-9b92-413b-8e5f-644aa0aa0951 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:41.043322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5f674b2-9b92-413b-8e5f-644aa0aa0951 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:41.043771 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-14005857-1884-4f2c-81b9-1c066c7be0ab tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:41.044017 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5f674b2-9b92-413b-8e5f-644aa0aa0951 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:41.044470 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5f674b2-9b92-413b-8e5f-644aa0aa0951 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:41.044892 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5f674b2-9b92-413b-8e5f-644aa0aa0951 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:41.052162 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-14005857-1884-4f2c-81b9-1c066c7be0ab tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1217 microversion: 2.1 time: 0.087437 Aug 18 11:03:41.052919 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 76/149] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:40 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:41.180426 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b5f674b2-9b92-413b-8e5f-644aa0aa0951 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:41.188210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b5f674b2-9b92-413b-8e5f-644aa0aa0951 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.156247 Aug 18 11:03:41.188792 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 74/150] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:41 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:41.779123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f11a4ffe-1e6b-4c38-97b9-2b0a066007ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:41.779743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f11a4ffe-1e6b-4c38-97b9-2b0a066007ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:41.786471 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f11a4ffe-1e6b-4c38-97b9-2b0a066007ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:41.787024 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f11a4ffe-1e6b-4c38-97b9-2b0a066007ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:41.787765 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f11a4ffe-1e6b-4c38-97b9-2b0a066007ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:41.788567 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f11a4ffe-1e6b-4c38-97b9-2b0a066007ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:41.789279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f11a4ffe-1e6b-4c38-97b9-2b0a066007ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:41.790054 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f11a4ffe-1e6b-4c38-97b9-2b0a066007ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:41.926912 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f11a4ffe-1e6b-4c38-97b9-2b0a066007ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:41.934846 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f11a4ffe-1e6b-4c38-97b9-2b0a066007ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.159393 Aug 18 11:03:41.935430 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 77/151] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:41 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:42.052559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:42.053376 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:42.059918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:42.060401 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:42.060834 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:42.061540 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:42.062937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:42.063753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:42.073081 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-bdd503e2-4e2d-4e36-b4ec-41ff380bc255 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:42.073737 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-bdd503e2-4e2d-4e36-b4ec-41ff380bc255 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:42.079764 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bdd503e2-4e2d-4e36-b4ec-41ff380bc255 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:42.080253 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bdd503e2-4e2d-4e36-b4ec-41ff380bc255 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:42.080685 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bdd503e2-4e2d-4e36-b4ec-41ff380bc255 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:42.081372 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bdd503e2-4e2d-4e36-b4ec-41ff380bc255 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:42.081876 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bdd503e2-4e2d-4e36-b4ec-41ff380bc255 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:42.082297 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bdd503e2-4e2d-4e36-b4ec-41ff380bc255 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:42.153221 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bdd503e2-4e2d-4e36-b4ec-41ff380bc255 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:42.161020 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-bdd503e2-4e2d-4e36-b4ec-41ff380bc255 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1217 microversion: 2.1 time: 0.091599 Aug 18 11:03:42.161662 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 78/152] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:42 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:42.205010 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:42.208613 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8fd52a16-1ae8-4e44-ba22-485bfd780fc9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:42.209278 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8fd52a16-1ae8-4e44-ba22-485bfd780fc9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:42.215598 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fd52a16-1ae8-4e44-ba22-485bfd780fc9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:42.216080 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fd52a16-1ae8-4e44-ba22-485bfd780fc9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:42.216511 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fd52a16-1ae8-4e44-ba22-485bfd780fc9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:42.217204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fd52a16-1ae8-4e44-ba22-485bfd780fc9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:42.217688 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fd52a16-1ae8-4e44-ba22-485bfd780fc9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:42.218107 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fd52a16-1ae8-4e44-ba22-485bfd780fc9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:42.228483 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:42.229923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:42.230889 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ffbd3042-3a74-4386-9a66-4dac2bfada28 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.182397 Aug 18 11:03:42.232004 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 75/153] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:42 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:42.368104 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8fd52a16-1ae8-4e44-ba22-485bfd780fc9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:42.376234 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8fd52a16-1ae8-4e44-ba22-485bfd780fc9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.171875 Aug 18 11:03:42.376796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 79/154] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:42 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:42.956356 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b97f2aca-0a3e-4987-94c9-028a176c1d3c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:42.956959 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b97f2aca-0a3e-4987-94c9-028a176c1d3c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:42.963903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b97f2aca-0a3e-4987-94c9-028a176c1d3c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:42.964430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b97f2aca-0a3e-4987-94c9-028a176c1d3c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:42.964894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b97f2aca-0a3e-4987-94c9-028a176c1d3c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:42.965680 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b97f2aca-0a3e-4987-94c9-028a176c1d3c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:42.966186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b97f2aca-0a3e-4987-94c9-028a176c1d3c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:42.966663 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b97f2aca-0a3e-4987-94c9-028a176c1d3c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:43.107382 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b97f2aca-0a3e-4987-94c9-028a176c1d3c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:43.115922 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b97f2aca-0a3e-4987-94c9-028a176c1d3c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.163384 Aug 18 11:03:43.116512 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 76/155] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:42 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:43.182537 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-112a13c5-bebe-458b-9400-3794ea453301 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:43.183191 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-112a13c5-bebe-458b-9400-3794ea453301 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:43.189344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-112a13c5-bebe-458b-9400-3794ea453301 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:43.189889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-112a13c5-bebe-458b-9400-3794ea453301 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:43.190348 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-112a13c5-bebe-458b-9400-3794ea453301 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:43.191096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-112a13c5-bebe-458b-9400-3794ea453301 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:43.191574 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-112a13c5-bebe-458b-9400-3794ea453301 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:43.192201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-112a13c5-bebe-458b-9400-3794ea453301 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:43.254612 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:43.255373 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:43.260169 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-112a13c5-bebe-458b-9400-3794ea453301 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:43.261909 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:43.262584 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:43.263024 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:43.263743 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:43.264201 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:43.264625 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:43.269039 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-112a13c5-bebe-458b-9400-3794ea453301 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1265 microversion: 2.1 time: 0.090793 Aug 18 11:03:43.269647 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 80/156] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:43 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:43.399106 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d5137329-33e3-4ed9-881c-bd90abf88b70 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:43.400184 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d5137329-33e3-4ed9-881c-bd90abf88b70 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:43.408109 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d5137329-33e3-4ed9-881c-bd90abf88b70 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:43.408709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d5137329-33e3-4ed9-881c-bd90abf88b70 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:43.409408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d5137329-33e3-4ed9-881c-bd90abf88b70 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:43.410026 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d5137329-33e3-4ed9-881c-bd90abf88b70 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:43.410572 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d5137329-33e3-4ed9-881c-bd90abf88b70 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:43.411112 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d5137329-33e3-4ed9-881c-bd90abf88b70 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:43.433134 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:43.441044 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:43.443376 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:43.444489 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0b8f3f08-8814-4993-9481-67dfe4fcedf2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.194218 Aug 18 11:03:43.445351 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 77/157] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:43 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:03:43.556588 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d5137329-33e3-4ed9-881c-bd90abf88b70 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:43.564185 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d5137329-33e3-4ed9-881c-bd90abf88b70 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.171236 Aug 18 11:03:43.564754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 81/158] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:43 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:44.137058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5d4f15db-dcb9-482e-89a1-7fe953ed8a0c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:44.137682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5d4f15db-dcb9-482e-89a1-7fe953ed8a0c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:44.144117 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d4f15db-dcb9-482e-89a1-7fe953ed8a0c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:44.144711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d4f15db-dcb9-482e-89a1-7fe953ed8a0c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:44.146436 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d4f15db-dcb9-482e-89a1-7fe953ed8a0c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:44.147136 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d4f15db-dcb9-482e-89a1-7fe953ed8a0c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:44.147601 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d4f15db-dcb9-482e-89a1-7fe953ed8a0c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:44.148034 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d4f15db-dcb9-482e-89a1-7fe953ed8a0c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:44.284495 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5d4f15db-dcb9-482e-89a1-7fe953ed8a0c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:44.290753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-da7c779d-5c27-4ad7-b3c1-998b10218994 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:44.291878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-da7c779d-5c27-4ad7-b3c1-998b10218994 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:44.292431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5d4f15db-dcb9-482e-89a1-7fe953ed8a0c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.159170 Aug 18 11:03:44.293012 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 78/159] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:44 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:44.297794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da7c779d-5c27-4ad7-b3c1-998b10218994 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:44.298268 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da7c779d-5c27-4ad7-b3c1-998b10218994 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:44.298691 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da7c779d-5c27-4ad7-b3c1-998b10218994 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:44.299365 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da7c779d-5c27-4ad7-b3c1-998b10218994 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:44.299810 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da7c779d-5c27-4ad7-b3c1-998b10218994 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:44.300225 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da7c779d-5c27-4ad7-b3c1-998b10218994 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:44.362918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-da7c779d-5c27-4ad7-b3c1-998b10218994 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:44.373892 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-da7c779d-5c27-4ad7-b3c1-998b10218994 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1265 microversion: 2.1 time: 0.086946 Aug 18 11:03:44.374877 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 82/160] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:44 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:44.467509 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:44.468112 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:44.474223 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:44.474711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:44.475146 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:44.475833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:44.476287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:44.476710 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:44.585873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d3e76a6c-b1c3-4594-90b1-54d30dc45379 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:44.586814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d3e76a6c-b1c3-4594-90b1-54d30dc45379 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:44.592879 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3e76a6c-b1c3-4594-90b1-54d30dc45379 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:44.593351 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3e76a6c-b1c3-4594-90b1-54d30dc45379 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:44.593801 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3e76a6c-b1c3-4594-90b1-54d30dc45379 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:44.594487 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3e76a6c-b1c3-4594-90b1-54d30dc45379 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:44.594928 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3e76a6c-b1c3-4594-90b1-54d30dc45379 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:44.595339 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3e76a6c-b1c3-4594-90b1-54d30dc45379 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:44.612149 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:44.621860 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:44.623368 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:44.624521 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2c89494c-8b59-4a47-8cf6-a585c482a0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.160962 Aug 18 11:03:44.625079 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 79/161] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:44 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:44.729040 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d3e76a6c-b1c3-4594-90b1-54d30dc45379 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:44.736561 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d3e76a6c-b1c3-4594-90b1-54d30dc45379 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.154936 Aug 18 11:03:44.737133 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 83/162] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:44 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:45.314413 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-60ebf857-2d46-4424-b140-8a8da70f4bf2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:45.315409 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-60ebf857-2d46-4424-b140-8a8da70f4bf2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:45.318151 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:45.325763 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60ebf857-2d46-4424-b140-8a8da70f4bf2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:45.326454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60ebf857-2d46-4424-b140-8a8da70f4bf2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:45.327192 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60ebf857-2d46-4424-b140-8a8da70f4bf2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:45.327921 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60ebf857-2d46-4424-b140-8a8da70f4bf2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:45.328382 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60ebf857-2d46-4424-b140-8a8da70f4bf2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:45.328801 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60ebf857-2d46-4424-b140-8a8da70f4bf2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:45.395526 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-83222b81-286d-4dae-b07c-a3aa65dec037 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:45.396322 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-83222b81-286d-4dae-b07c-a3aa65dec037 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:45.402580 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-83222b81-286d-4dae-b07c-a3aa65dec037 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:45.403069 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-83222b81-286d-4dae-b07c-a3aa65dec037 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:45.403640 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-83222b81-286d-4dae-b07c-a3aa65dec037 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:45.404362 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-83222b81-286d-4dae-b07c-a3aa65dec037 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:45.405082 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-83222b81-286d-4dae-b07c-a3aa65dec037 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:45.405693 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-83222b81-286d-4dae-b07c-a3aa65dec037 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:45.477838 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-60ebf857-2d46-4424-b140-8a8da70f4bf2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:45.478505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-83222b81-286d-4dae-b07c-a3aa65dec037 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:45.485551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-60ebf857-2d46-4424-b140-8a8da70f4bf2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.175621 Aug 18 11:03:45.486161 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 80/163] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:45 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:45.486959 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-83222b81-286d-4dae-b07c-a3aa65dec037 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1265 microversion: 2.1 time: 0.095831 Aug 18 11:03:45.487594 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 84/164] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:45 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:45.647888 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:45.648590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:45.656759 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:45.657556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:45.657977 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:45.658898 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:45.659777 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:45.660080 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:45.758604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7d5b46ae-c199-4d91-8682-84254594d357 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:45.759485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7d5b46ae-c199-4d91-8682-84254594d357 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:45.765123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=100 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:45.766412 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d5b46ae-c199-4d91-8682-84254594d357 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:45.766897 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d5b46ae-c199-4d91-8682-84254594d357 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:45.767328 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d5b46ae-c199-4d91-8682-84254594d357 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:45.768020 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d5b46ae-c199-4d91-8682-84254594d357 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:45.768471 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d5b46ae-c199-4d91-8682-84254594d357 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:45.768893 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d5b46ae-c199-4d91-8682-84254594d357 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:45.797892 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:45.806786 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:45.808414 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:45.809739 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-51749d91-1099-4132-8a40-505351b96463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.166833 Aug 18 11:03:45.810306 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 81/165] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:45 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:45.912960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7d5b46ae-c199-4d91-8682-84254594d357 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:45.920817 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7d5b46ae-c199-4d91-8682-84254594d357 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.166597 Aug 18 11:03:45.921389 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 85/166] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:45 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:46.509026 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c3558a21-88c0-4522-815e-cd0c947572a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:46.509727 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c3558a21-88c0-4522-815e-cd0c947572a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:46.510832 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5baf45a9-017c-4dca-9e1b-a3c8377a2089 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:46.511561 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5baf45a9-017c-4dca-9e1b-a3c8377a2089 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:46.516195 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3558a21-88c0-4522-815e-cd0c947572a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:46.516684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3558a21-88c0-4522-815e-cd0c947572a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:46.517126 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3558a21-88c0-4522-815e-cd0c947572a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:46.517561 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5baf45a9-017c-4dca-9e1b-a3c8377a2089 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:46.517848 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3558a21-88c0-4522-815e-cd0c947572a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:46.518072 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5baf45a9-017c-4dca-9e1b-a3c8377a2089 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:46.518310 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3558a21-88c0-4522-815e-cd0c947572a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:46.518485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5baf45a9-017c-4dca-9e1b-a3c8377a2089 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:46.518735 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3558a21-88c0-4522-815e-cd0c947572a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:46.519174 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5baf45a9-017c-4dca-9e1b-a3c8377a2089 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:46.519627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5baf45a9-017c-4dca-9e1b-a3c8377a2089 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:46.520049 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5baf45a9-017c-4dca-9e1b-a3c8377a2089 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:46.592716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5baf45a9-017c-4dca-9e1b-a3c8377a2089 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:46.601891 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5baf45a9-017c-4dca-9e1b-a3c8377a2089 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1265 microversion: 2.1 time: 0.094891 Aug 18 11:03:46.602464 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 86/167] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:46 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:46.666878 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c3558a21-88c0-4522-815e-cd0c947572a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:46.675846 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c3558a21-88c0-4522-815e-cd0c947572a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.171598 Aug 18 11:03:46.677588 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 82/168] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:46 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:46.833682 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:46.834299 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:46.840699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:46.841114 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:46.841560 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:46.842416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:46.843136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:46.843540 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:46.942958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c683acbb-bd82-48ac-a4e7-632a183dddc1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:46.943569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c683acbb-bd82-48ac-a4e7-632a183dddc1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:46.950338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c683acbb-bd82-48ac-a4e7-632a183dddc1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:46.951079 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c683acbb-bd82-48ac-a4e7-632a183dddc1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:46.951672 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c683acbb-bd82-48ac-a4e7-632a183dddc1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:46.952381 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c683acbb-bd82-48ac-a4e7-632a183dddc1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:46.952948 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c683acbb-bd82-48ac-a4e7-632a183dddc1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:46.953375 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c683acbb-bd82-48ac-a4e7-632a183dddc1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:46.994317 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:47.005336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:47.007263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:47.008505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8b4425be-e955-40fc-996d-4acf9ec4efec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.179881 Aug 18 11:03:47.009411 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 87/169] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:46 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:03:47.014194 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-6a6b3505-1b47-41e3-a53f-1fd9334ba7fb req-e349603d-ed4c-4de7-8b9e-f63c2b6f83e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36caff1-93fb-4fd8-8727-9aa6b23ee576", "name": "network-vif-plugged", "status": "completed", "tag": "d14edd58-652d-4c9e-b988-a4e1b455c2b1"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:47.025810 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-6a6b3505-1b47-41e3-a53f-1fd9334ba7fb req-e349603d-ed4c-4de7-8b9e-f63c2b6f83e7 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:47.026434 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-6a6b3505-1b47-41e3-a53f-1fd9334ba7fb req-e349603d-ed4c-4de7-8b9e-f63c2b6f83e7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:47.027499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-6a6b3505-1b47-41e3-a53f-1fd9334ba7fb req-e349603d-ed4c-4de7-8b9e-f63c2b6f83e7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:47.048726 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-6a6b3505-1b47-41e3-a53f-1fd9334ba7fb req-e349603d-ed4c-4de7-8b9e-f63c2b6f83e7 service nova] Creating event network-vif-plugged:d14edd58-652d-4c9e-b988-a4e1b455c2b1 for instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 on hv-cinder-82660 Aug 18 11:03:47.062651 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-6a6b3505-1b47-41e3-a53f-1fd9334ba7fb req-e349603d-ed4c-4de7-8b9e-f63c2b6f83e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051531 Aug 18 11:03:47.066319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 88/170] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:47.096139 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7176a4cf-295e-4e71-9dcc-462d09c70e3e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40445416-55a4-4e28-81db-77bdf9e790c8"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:47.098656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7176a4cf-295e-4e71-9dcc-462d09c70e3e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:47.105070 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7176a4cf-295e-4e71-9dcc-462d09c70e3e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:47.105619 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7176a4cf-295e-4e71-9dcc-462d09c70e3e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:47.106128 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7176a4cf-295e-4e71-9dcc-462d09c70e3e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:47.106447 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7176a4cf-295e-4e71-9dcc-462d09c70e3e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:47.106904 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7176a4cf-295e-4e71-9dcc-462d09c70e3e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:47.107320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7176a4cf-295e-4e71-9dcc-462d09c70e3e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:47.108749 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c683acbb-bd82-48ac-a4e7-632a183dddc1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:47.116533 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c683acbb-bd82-48ac-a4e7-632a183dddc1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.177642 Aug 18 11:03:47.117198 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 83/171] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:46 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:47.623954 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4a32cada-3e9e-42e1-a175-c7ebe7e830dd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:47.624670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4a32cada-3e9e-42e1-a175-c7ebe7e830dd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:47.631087 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a32cada-3e9e-42e1-a175-c7ebe7e830dd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:47.631578 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a32cada-3e9e-42e1-a175-c7ebe7e830dd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:47.632014 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a32cada-3e9e-42e1-a175-c7ebe7e830dd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:47.632704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a32cada-3e9e-42e1-a175-c7ebe7e830dd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:47.633155 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a32cada-3e9e-42e1-a175-c7ebe7e830dd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:47.633597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a32cada-3e9e-42e1-a175-c7ebe7e830dd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:47.700562 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4a32cada-3e9e-42e1-a175-c7ebe7e830dd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:47.708786 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4a32cada-3e9e-42e1-a175-c7ebe7e830dd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1273 microversion: 2.1 time: 0.088641 Aug 18 11:03:47.709353 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 84/172] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:47 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:47.713845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-aef89435-a3f7-48bc-9a2c-e08dd66c9154 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:47.714439 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-aef89435-a3f7-48bc-9a2c-e08dd66c9154 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:47.720081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aef89435-a3f7-48bc-9a2c-e08dd66c9154 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:47.720556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aef89435-a3f7-48bc-9a2c-e08dd66c9154 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:47.720984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aef89435-a3f7-48bc-9a2c-e08dd66c9154 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:47.721707 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aef89435-a3f7-48bc-9a2c-e08dd66c9154 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:47.722156 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aef89435-a3f7-48bc-9a2c-e08dd66c9154 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:47.722576 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aef89435-a3f7-48bc-9a2c-e08dd66c9154 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:47.860941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-aef89435-a3f7-48bc-9a2c-e08dd66c9154 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:47.868655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-aef89435-a3f7-48bc-9a2c-e08dd66c9154 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.158183 Aug 18 11:03:47.869249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 85/173] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:47 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:48.035625 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:48.036451 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:48.042770 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:48.043249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:48.043707 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:48.044392 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:48.044845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:48.045265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:48.060331 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=100 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:48.181942 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:48.189883 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:48.191397 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:48.193812 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-cf22ff74-2450-41b9-8169-bf1f30aa3132 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.162178 Aug 18 11:03:48.194384 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 86/174] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:48 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:03:48.198735 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fb1d6b81-bcda-49aa-9ea4-681d51d6ba13 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:48.199336 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fb1d6b81-bcda-49aa-9ea4-681d51d6ba13 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:48.205176 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb1d6b81-bcda-49aa-9ea4-681d51d6ba13 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:48.205704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb1d6b81-bcda-49aa-9ea4-681d51d6ba13 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:48.206438 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb1d6b81-bcda-49aa-9ea4-681d51d6ba13 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:48.207069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb1d6b81-bcda-49aa-9ea4-681d51d6ba13 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:48.209249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb1d6b81-bcda-49aa-9ea4-681d51d6ba13 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:48.209249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb1d6b81-bcda-49aa-9ea4-681d51d6ba13 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:48.345258 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-fb1d6b81-bcda-49aa-9ea4-681d51d6ba13 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:48.353624 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fb1d6b81-bcda-49aa-9ea4-681d51d6ba13 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.158210 Aug 18 11:03:48.354206 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 87/175] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:48 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:48.730087 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-55897254-bb73-404b-9d3f-06e7ce6b6373 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:48.730738 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-55897254-bb73-404b-9d3f-06e7ce6b6373 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:48.736586 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55897254-bb73-404b-9d3f-06e7ce6b6373 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:48.737065 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55897254-bb73-404b-9d3f-06e7ce6b6373 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:48.737502 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55897254-bb73-404b-9d3f-06e7ce6b6373 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:48.738212 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55897254-bb73-404b-9d3f-06e7ce6b6373 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:48.739229 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55897254-bb73-404b-9d3f-06e7ce6b6373 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:48.739665 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55897254-bb73-404b-9d3f-06e7ce6b6373 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:48.804919 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-55897254-bb73-404b-9d3f-06e7ce6b6373 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:48.812528 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-55897254-bb73-404b-9d3f-06e7ce6b6373 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1273 microversion: 2.1 time: 0.086241 Aug 18 11:03:48.813101 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 88/176] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:48 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:48.890871 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2dc58d5a-5999-4a1d-b099-f170e4a53a53 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:48.891122 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2dc58d5a-5999-4a1d-b099-f170e4a53a53 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:48.897381 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2dc58d5a-5999-4a1d-b099-f170e4a53a53 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:48.897920 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2dc58d5a-5999-4a1d-b099-f170e4a53a53 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:48.898362 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2dc58d5a-5999-4a1d-b099-f170e4a53a53 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:48.899072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2dc58d5a-5999-4a1d-b099-f170e4a53a53 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:48.899531 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2dc58d5a-5999-4a1d-b099-f170e4a53a53 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:48.899958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2dc58d5a-5999-4a1d-b099-f170e4a53a53 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:49.050463 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2dc58d5a-5999-4a1d-b099-f170e4a53a53 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:49.058364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2dc58d5a-5999-4a1d-b099-f170e4a53a53 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.171771 Aug 18 11:03:49.058943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 89/177] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:48 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:49.217571 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:49.218185 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:49.225195 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:49.225726 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:49.226162 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:49.226859 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:49.227310 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:49.227732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:49.366007 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:49.374941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:49.376497 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:49.378091 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-06093ce9-3dac-48a7-b917-91bb3da2017c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1407 microversion: 2.20 time: 0.164033 Aug 18 11:03:49.378459 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 90/178] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:49 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:03:49.383980 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e642c28a-ef71-45ca-a786-ca07880cf7a9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:49.384619 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e642c28a-ef71-45ca-a786-ca07880cf7a9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:49.391032 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e642c28a-ef71-45ca-a786-ca07880cf7a9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:49.391541 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e642c28a-ef71-45ca-a786-ca07880cf7a9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:49.391985 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e642c28a-ef71-45ca-a786-ca07880cf7a9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:49.392815 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e642c28a-ef71-45ca-a786-ca07880cf7a9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:49.393182 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e642c28a-ef71-45ca-a786-ca07880cf7a9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:49.393632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e642c28a-ef71-45ca-a786-ca07880cf7a9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:49.528907 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e642c28a-ef71-45ca-a786-ca07880cf7a9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:49.536610 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e642c28a-ef71-45ca-a786-ca07880cf7a9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.157146 Aug 18 11:03:49.537187 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 91/179] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:49 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:49.834241 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9df3f2e5-d059-4ea3-9b56-48781d639d2f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:49.834930 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9df3f2e5-d059-4ea3-9b56-48781d639d2f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:49.836677 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:49.837336 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=6 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:49.843099 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9df3f2e5-d059-4ea3-9b56-48781d639d2f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:49.843581 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9df3f2e5-d059-4ea3-9b56-48781d639d2f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:49.844015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9df3f2e5-d059-4ea3-9b56-48781d639d2f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:49.844996 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9df3f2e5-d059-4ea3-9b56-48781d639d2f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:49.845463 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9df3f2e5-d059-4ea3-9b56-48781d639d2f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:49.845939 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9df3f2e5-d059-4ea3-9b56-48781d639d2f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:49.913233 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9df3f2e5-d059-4ea3-9b56-48781d639d2f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:49.921092 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9df3f2e5-d059-4ea3-9b56-48781d639d2f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1273 microversion: 2.1 time: 0.091272 Aug 18 11:03:49.921685 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 92/180] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:49 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:49.938868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:50.079969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2cbe99f3-ad31-4823-a40a-fa4b43088bdf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:50.080606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2cbe99f3-ad31-4823-a40a-fa4b43088bdf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:50.088162 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cbe99f3-ad31-4823-a40a-fa4b43088bdf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:50.088562 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cbe99f3-ad31-4823-a40a-fa4b43088bdf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:50.088992 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cbe99f3-ad31-4823-a40a-fa4b43088bdf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:50.089769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cbe99f3-ad31-4823-a40a-fa4b43088bdf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:50.090227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cbe99f3-ad31-4823-a40a-fa4b43088bdf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:50.090647 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cbe99f3-ad31-4823-a40a-fa4b43088bdf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:50.232740 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2cbe99f3-ad31-4823-a40a-fa4b43088bdf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:50.241052 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2cbe99f3-ad31-4823-a40a-fa4b43088bdf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.164973 Aug 18 11:03:50.241664 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 93/181] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:50 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:50.402781 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:50.403300 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:50.409601 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:50.410098 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:50.410609 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:50.411412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:50.411892 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:50.412315 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:50.553886 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:50.562949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:50.564613 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:50.565848 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-498cd495-2b7b-41d6-82d2-b16351aebb92 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1599 microversion: 2.20 time: 0.167078 Aug 18 11:03:50.567552 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 94/182] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:03:50 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:03:50.575849 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9971ee16-373f-474c-9713-50af4dc98073 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:50.576434 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9971ee16-373f-474c-9713-50af4dc98073 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:50.596125 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9971ee16-373f-474c-9713-50af4dc98073 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:50.596887 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9971ee16-373f-474c-9713-50af4dc98073 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:50.597493 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9971ee16-373f-474c-9713-50af4dc98073 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:50.599070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9971ee16-373f-474c-9713-50af4dc98073 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:50.599623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9971ee16-373f-474c-9713-50af4dc98073 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:50.600156 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9971ee16-373f-474c-9713-50af4dc98073 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:50.752884 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9971ee16-373f-474c-9713-50af4dc98073 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:50.763352 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9971ee16-373f-474c-9713-50af4dc98073 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.194604 Aug 18 11:03:50.763935 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 95/183] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:50 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:50.768783 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ff5d061f-a9b0-4409-869e-c775005662ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:50.769269 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ff5d061f-a9b0-4409-869e-c775005662ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:50.775466 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff5d061f-a9b0-4409-869e-c775005662ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:50.775883 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff5d061f-a9b0-4409-869e-c775005662ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:50.776305 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff5d061f-a9b0-4409-869e-c775005662ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:50.777083 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff5d061f-a9b0-4409-869e-c775005662ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:50.777432 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff5d061f-a9b0-4409-869e-c775005662ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:50.777893 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ff5d061f-a9b0-4409-869e-c775005662ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:50.857953 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ff5d061f-a9b0-4409-869e-c775005662ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092725 Aug 18 11:03:50.858766 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 96/184] 10.222.0.15 () {60 vars in 1316 bytes} [Thu Aug 18 11:03:50 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:03:50.944825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7581d8a3-1591-415b-b680-e13fc53f9c46 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:50.945444 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7581d8a3-1591-415b-b680-e13fc53f9c46 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:50.957197 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7581d8a3-1591-415b-b680-e13fc53f9c46 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:50.957929 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7581d8a3-1591-415b-b680-e13fc53f9c46 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:50.958405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7581d8a3-1591-415b-b680-e13fc53f9c46 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:50.959150 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7581d8a3-1591-415b-b680-e13fc53f9c46 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:50.959610 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7581d8a3-1591-415b-b680-e13fc53f9c46 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:50.960039 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7581d8a3-1591-415b-b680-e13fc53f9c46 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:51.113343 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7581d8a3-1591-415b-b680-e13fc53f9c46 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:51.124475 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7581d8a3-1591-415b-b680-e13fc53f9c46 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1271 microversion: 2.1 time: 0.186657 Aug 18 11:03:51.125474 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 97/185] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:50 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:51.264166 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a2d6d74d-95b1-4260-93c8-a202c529b06f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:51.264978 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a2d6d74d-95b1-4260-93c8-a202c529b06f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:51.281172 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a2d6d74d-95b1-4260-93c8-a202c529b06f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:51.281793 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a2d6d74d-95b1-4260-93c8-a202c529b06f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:51.283715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a2d6d74d-95b1-4260-93c8-a202c529b06f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:51.284527 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a2d6d74d-95b1-4260-93c8-a202c529b06f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:51.287733 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a2d6d74d-95b1-4260-93c8-a202c529b06f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:51.288560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a2d6d74d-95b1-4260-93c8-a202c529b06f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:51.473326 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:51.501553 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7176a4cf-295e-4e71-9dcc-462d09c70e3e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "POST /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.408983 Aug 18 11:03:51.508681 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 89/186] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:03:47 2022] POST /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582/os-volume_attachments => generated 194 bytes in 4418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:03:51.594955 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a2d6d74d-95b1-4260-93c8-a202c529b06f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:51.608218 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a2d6d74d-95b1-4260-93c8-a202c529b06f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.349495 Aug 18 11:03:51.609188 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 98/187] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:51 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:51.787828 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-edf52d4e-472a-4bfb-a226-8e749b8448ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:51.789496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-edf52d4e-472a-4bfb-a226-8e749b8448ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:51.802447 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edf52d4e-472a-4bfb-a226-8e749b8448ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:51.802976 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edf52d4e-472a-4bfb-a226-8e749b8448ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:51.803417 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edf52d4e-472a-4bfb-a226-8e749b8448ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:51.804124 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edf52d4e-472a-4bfb-a226-8e749b8448ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:51.804572 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edf52d4e-472a-4bfb-a226-8e749b8448ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:51.810772 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edf52d4e-472a-4bfb-a226-8e749b8448ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:52.038766 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-edf52d4e-472a-4bfb-a226-8e749b8448ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:52.064819 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-edf52d4e-472a-4bfb-a226-8e749b8448ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.282396 Aug 18 11:03:52.068989 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 90/188] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:51 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:52.148979 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fd1b3093-dce3-49eb-886d-cb35cc45c04a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:52.149753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fd1b3093-dce3-49eb-886d-cb35cc45c04a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:52.156712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd1b3093-dce3-49eb-886d-cb35cc45c04a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:52.157203 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd1b3093-dce3-49eb-886d-cb35cc45c04a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:52.157668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd1b3093-dce3-49eb-886d-cb35cc45c04a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:52.158380 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd1b3093-dce3-49eb-886d-cb35cc45c04a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:52.158838 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd1b3093-dce3-49eb-886d-cb35cc45c04a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:52.159258 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd1b3093-dce3-49eb-886d-cb35cc45c04a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:52.492849 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-fd1b3093-dce3-49eb-886d-cb35cc45c04a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:52.500908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fd1b3093-dce3-49eb-886d-cb35cc45c04a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.356252 Aug 18 11:03:52.501715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 99/189] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:52 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:52.632295 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0e890800-1a6d-4c5a-a88a-d81b8278b882 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:52.633582 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0e890800-1a6d-4c5a-a88a-d81b8278b882 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:52.640408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0e890800-1a6d-4c5a-a88a-d81b8278b882 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:52.640903 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0e890800-1a6d-4c5a-a88a-d81b8278b882 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:52.641339 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0e890800-1a6d-4c5a-a88a-d81b8278b882 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:52.642067 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0e890800-1a6d-4c5a-a88a-d81b8278b882 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:52.642524 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0e890800-1a6d-4c5a-a88a-d81b8278b882 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:52.642980 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0e890800-1a6d-4c5a-a88a-d81b8278b882 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:52.796386 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0e890800-1a6d-4c5a-a88a-d81b8278b882 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:52.805819 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0e890800-1a6d-4c5a-a88a-d81b8278b882 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.177923 Aug 18 11:03:52.806579 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 91/190] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:52 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:52.893085 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-e19a907f-4082-422b-983c-1a7509957467 req-65afc955-e3f7-4bc7-93be-459bd0fc17e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e210ba46-e81e-4939-b202-4b569f906d8b", "tag": "850023d2-3a9f-4c57-85af-2b31e7f7b114"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:52.903940 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-e19a907f-4082-422b-983c-1a7509957467 req-65afc955-e3f7-4bc7-93be-459bd0fc17e7 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:52.904413 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-e19a907f-4082-422b-983c-1a7509957467 req-65afc955-e3f7-4bc7-93be-459bd0fc17e7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:52.904835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-e19a907f-4082-422b-983c-1a7509957467 req-65afc955-e3f7-4bc7-93be-459bd0fc17e7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:52.917550 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-e19a907f-4082-422b-983c-1a7509957467 req-65afc955-e3f7-4bc7-93be-459bd0fc17e7 service nova] Creating event network-changed:850023d2-3a9f-4c57-85af-2b31e7f7b114 for instance e210ba46-e81e-4939-b202-4b569f906d8b on hv-cinder-82660 Aug 18 11:03:52.923394 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-e19a907f-4082-422b-983c-1a7509957467 req-65afc955-e3f7-4bc7-93be-459bd0fc17e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035758 Aug 18 11:03:52.924013 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 100/191] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:53.089707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-acc35fc0-d2d9-4c80-a167-087a2b6e54cf tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:53.090476 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-acc35fc0-d2d9-4c80-a167-087a2b6e54cf tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:53.097683 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-acc35fc0-d2d9-4c80-a167-087a2b6e54cf tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:53.099227 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-acc35fc0-d2d9-4c80-a167-087a2b6e54cf tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:53.099227 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-acc35fc0-d2d9-4c80-a167-087a2b6e54cf tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:53.099787 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-acc35fc0-d2d9-4c80-a167-087a2b6e54cf tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:53.100234 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-acc35fc0-d2d9-4c80-a167-087a2b6e54cf tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:53.100648 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-acc35fc0-d2d9-4c80-a167-087a2b6e54cf tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:53.239905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-acc35fc0-d2d9-4c80-a167-087a2b6e54cf tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:53.246444 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-acc35fc0-d2d9-4c80-a167-087a2b6e54cf tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.160869 Aug 18 11:03:53.247093 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 92/192] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:53 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:53.523667 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7e028517-70f5-4f7a-af69-d8e2e024e0f9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:53.524455 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7e028517-70f5-4f7a-af69-d8e2e024e0f9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:53.530883 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7e028517-70f5-4f7a-af69-d8e2e024e0f9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:53.531379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7e028517-70f5-4f7a-af69-d8e2e024e0f9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:53.531810 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7e028517-70f5-4f7a-af69-d8e2e024e0f9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:53.532816 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7e028517-70f5-4f7a-af69-d8e2e024e0f9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:53.533282 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7e028517-70f5-4f7a-af69-d8e2e024e0f9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:53.533625 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7e028517-70f5-4f7a-af69-d8e2e024e0f9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:53.677914 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7e028517-70f5-4f7a-af69-d8e2e024e0f9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:53.685728 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7e028517-70f5-4f7a-af69-d8e2e024e0f9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.167013 Aug 18 11:03:53.686320 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 101/193] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:53 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:53.827594 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3903f103-a7cf-4783-895c-e830812d4a22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:53.828480 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3903f103-a7cf-4783-895c-e830812d4a22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:53.836842 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3903f103-a7cf-4783-895c-e830812d4a22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:53.837399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3903f103-a7cf-4783-895c-e830812d4a22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:53.837874 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3903f103-a7cf-4783-895c-e830812d4a22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:53.839041 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3903f103-a7cf-4783-895c-e830812d4a22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:53.839338 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3903f103-a7cf-4783-895c-e830812d4a22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:53.839762 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3903f103-a7cf-4783-895c-e830812d4a22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:53.989663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3903f103-a7cf-4783-895c-e830812d4a22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:53.998662 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3903f103-a7cf-4783-895c-e830812d4a22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.174877 Aug 18 11:03:53.999249 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 93/194] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:53 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:54.267492 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8053690f-a672-44a7-aa0b-75c47b822c1f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:54.268232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8053690f-a672-44a7-aa0b-75c47b822c1f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:54.274751 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8053690f-a672-44a7-aa0b-75c47b822c1f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:54.275293 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8053690f-a672-44a7-aa0b-75c47b822c1f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:54.275729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8053690f-a672-44a7-aa0b-75c47b822c1f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:54.276494 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8053690f-a672-44a7-aa0b-75c47b822c1f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:54.276931 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8053690f-a672-44a7-aa0b-75c47b822c1f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:54.277509 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8053690f-a672-44a7-aa0b-75c47b822c1f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:54.425565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8053690f-a672-44a7-aa0b-75c47b822c1f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:54.433779 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8053690f-a672-44a7-aa0b-75c47b822c1f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.170084 Aug 18 11:03:54.434356 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 102/195] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:54 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:54.707288 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-847cca4f-f159-4eec-ba1d-57730d21bf55 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:54.708212 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-847cca4f-f159-4eec-ba1d-57730d21bf55 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:54.715191 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-847cca4f-f159-4eec-ba1d-57730d21bf55 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:54.716027 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-847cca4f-f159-4eec-ba1d-57730d21bf55 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:54.716520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-847cca4f-f159-4eec-ba1d-57730d21bf55 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:54.717469 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-847cca4f-f159-4eec-ba1d-57730d21bf55 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:54.718035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-847cca4f-f159-4eec-ba1d-57730d21bf55 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:54.718532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-847cca4f-f159-4eec-ba1d-57730d21bf55 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:55.027903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4bf5cbbe-ff37-46da-a9dd-d745173789c0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:55.029156 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4bf5cbbe-ff37-46da-a9dd-d745173789c0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:55.033852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-847cca4f-f159-4eec-ba1d-57730d21bf55 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:55.038378 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bf5cbbe-ff37-46da-a9dd-d745173789c0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:55.039526 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bf5cbbe-ff37-46da-a9dd-d745173789c0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:55.040216 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bf5cbbe-ff37-46da-a9dd-d745173789c0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:55.041148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bf5cbbe-ff37-46da-a9dd-d745173789c0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:55.042217 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bf5cbbe-ff37-46da-a9dd-d745173789c0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:55.042843 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bf5cbbe-ff37-46da-a9dd-d745173789c0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:55.050004 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-847cca4f-f159-4eec-ba1d-57730d21bf55 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.346243 Aug 18 11:03:55.052024 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 94/196] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:54 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:55.260244 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4bf5cbbe-ff37-46da-a9dd-d745173789c0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:55.268783 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4bf5cbbe-ff37-46da-a9dd-d745173789c0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.247019 Aug 18 11:03:55.270332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 103/197] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:55 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:03:55.455564 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-af65989f-2df8-4db2-95af-78bc606bba53 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:55.456205 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-af65989f-2df8-4db2-95af-78bc606bba53 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:55.463237 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af65989f-2df8-4db2-95af-78bc606bba53 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:55.463641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af65989f-2df8-4db2-95af-78bc606bba53 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:55.464071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af65989f-2df8-4db2-95af-78bc606bba53 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:55.464964 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af65989f-2df8-4db2-95af-78bc606bba53 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:55.465601 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af65989f-2df8-4db2-95af-78bc606bba53 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:55.466047 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af65989f-2df8-4db2-95af-78bc606bba53 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:55.526311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-220edd45-7ce1-4ab1-a440-044e43699ce9 req-92d74122-630f-456f-8b83-a5d73eefd45b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a19e95d-516b-457e-8b0f-00794fb8a6e0", "tag": "a03dceb4-130c-42d9-b3e6-7ab74008e2be"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:55.539670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-220edd45-7ce1-4ab1-a440-044e43699ce9 req-92d74122-630f-456f-8b83-a5d73eefd45b service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:55.540485 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-220edd45-7ce1-4ab1-a440-044e43699ce9 req-92d74122-630f-456f-8b83-a5d73eefd45b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:55.541066 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-220edd45-7ce1-4ab1-a440-044e43699ce9 req-92d74122-630f-456f-8b83-a5d73eefd45b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:55.547008 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=100 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:03:55.560546 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-220edd45-7ce1-4ab1-a440-044e43699ce9 req-92d74122-630f-456f-8b83-a5d73eefd45b service nova] Creating event network-changed:a03dceb4-130c-42d9-b3e6-7ab74008e2be for instance 3a19e95d-516b-457e-8b0f-00794fb8a6e0 on hv-cinder-82660 Aug 18 11:03:55.566163 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-220edd45-7ce1-4ab1-a440-044e43699ce9 req-92d74122-630f-456f-8b83-a5d73eefd45b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047050 Aug 18 11:03:55.567947 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 104/198] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:55.771824 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-af65989f-2df8-4db2-95af-78bc606bba53 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:55.782380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-af65989f-2df8-4db2-95af-78bc606bba53 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.330555 Aug 18 11:03:55.783823 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 95/199] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:55 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:56.084416 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c8cdc4c6-ec7c-4357-9384-19f866d2411b tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:56.085129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c8cdc4c6-ec7c-4357-9384-19f866d2411b tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:56.091682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8cdc4c6-ec7c-4357-9384-19f866d2411b tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:56.092181 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8cdc4c6-ec7c-4357-9384-19f866d2411b tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:56.092622 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8cdc4c6-ec7c-4357-9384-19f866d2411b tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:56.093328 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8cdc4c6-ec7c-4357-9384-19f866d2411b tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:56.093811 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8cdc4c6-ec7c-4357-9384-19f866d2411b tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:56.094272 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8cdc4c6-ec7c-4357-9384-19f866d2411b tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:56.235684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c8cdc4c6-ec7c-4357-9384-19f866d2411b tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:56.243675 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c8cdc4c6-ec7c-4357-9384-19f866d2411b tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.173830 Aug 18 11:03:56.244237 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 105/200] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:56 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:56.292914 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0f1d1a30-65d1-488b-8408-5c1067a8013a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:56.293536 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0f1d1a30-65d1-488b-8408-5c1067a8013a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:56.300019 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f1d1a30-65d1-488b-8408-5c1067a8013a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:56.300503 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f1d1a30-65d1-488b-8408-5c1067a8013a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:56.300970 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f1d1a30-65d1-488b-8408-5c1067a8013a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:56.301856 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f1d1a30-65d1-488b-8408-5c1067a8013a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:56.302313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f1d1a30-65d1-488b-8408-5c1067a8013a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:56.302738 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f1d1a30-65d1-488b-8408-5c1067a8013a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:56.731284 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0f1d1a30-65d1-488b-8408-5c1067a8013a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:56.743263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0f1d1a30-65d1-488b-8408-5c1067a8013a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.454513 Aug 18 11:03:56.744426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 96/201] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:56 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:56.805923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e638d44a-b2f4-4d78-afad-4d724957fd18 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:56.806499 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e638d44a-b2f4-4d78-afad-4d724957fd18 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:56.812560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e638d44a-b2f4-4d78-afad-4d724957fd18 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:56.814101 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e638d44a-b2f4-4d78-afad-4d724957fd18 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:56.814640 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e638d44a-b2f4-4d78-afad-4d724957fd18 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:56.817166 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e638d44a-b2f4-4d78-afad-4d724957fd18 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:56.817936 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e638d44a-b2f4-4d78-afad-4d724957fd18 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:56.819804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e638d44a-b2f4-4d78-afad-4d724957fd18 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:56.985865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e638d44a-b2f4-4d78-afad-4d724957fd18 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:56.996076 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e638d44a-b2f4-4d78-afad-4d724957fd18 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1366 microversion: 2.1 time: 0.194055 Aug 18 11:03:56.996837 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 106/202] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:56 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:57.265079 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8666f315-09e6-45e5-90e9-f91ae96619ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:57.265731 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8666f315-09e6-45e5-90e9-f91ae96619ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:57.278139 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8666f315-09e6-45e5-90e9-f91ae96619ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:57.278652 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8666f315-09e6-45e5-90e9-f91ae96619ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:57.279063 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8666f315-09e6-45e5-90e9-f91ae96619ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:57.279791 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8666f315-09e6-45e5-90e9-f91ae96619ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:57.280269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8666f315-09e6-45e5-90e9-f91ae96619ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:57.280769 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8666f315-09e6-45e5-90e9-f91ae96619ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:57.437012 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8666f315-09e6-45e5-90e9-f91ae96619ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:57.446624 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8666f315-09e6-45e5-90e9-f91ae96619ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.185850 Aug 18 11:03:57.460144 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 97/203] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:57 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:57.765125 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-580ebdfc-a617-4e97-ae80-a3fa0960e280 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:57.765772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-580ebdfc-a617-4e97-ae80-a3fa0960e280 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:57.771910 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-580ebdfc-a617-4e97-ae80-a3fa0960e280 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:57.772397 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-580ebdfc-a617-4e97-ae80-a3fa0960e280 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:57.772831 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-580ebdfc-a617-4e97-ae80-a3fa0960e280 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:57.773548 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-580ebdfc-a617-4e97-ae80-a3fa0960e280 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:57.774007 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-580ebdfc-a617-4e97-ae80-a3fa0960e280 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:57.774428 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-580ebdfc-a617-4e97-ae80-a3fa0960e280 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:57.926472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-580ebdfc-a617-4e97-ae80-a3fa0960e280 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:57.934498 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-580ebdfc-a617-4e97-ae80-a3fa0960e280 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.173054 Aug 18 11:03:57.935102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 107/204] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:57 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:58.017778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6af1d26f-08e2-4c1d-9381-06ce542073d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:58.018425 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6af1d26f-08e2-4c1d-9381-06ce542073d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:58.024745 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6af1d26f-08e2-4c1d-9381-06ce542073d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:58.025237 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6af1d26f-08e2-4c1d-9381-06ce542073d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:58.025742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6af1d26f-08e2-4c1d-9381-06ce542073d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:58.026432 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6af1d26f-08e2-4c1d-9381-06ce542073d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:58.026882 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6af1d26f-08e2-4c1d-9381-06ce542073d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:58.027306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6af1d26f-08e2-4c1d-9381-06ce542073d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:58.157326 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6af1d26f-08e2-4c1d-9381-06ce542073d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:58.165791 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6af1d26f-08e2-4c1d-9381-06ce542073d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1556 microversion: 2.1 time: 0.151680 Aug 18 11:03:58.177786 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 98/205] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:58 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:58.188328 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0ff5618c-1472-4888-8834-67e3f6e6d1e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:58.189040 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0ff5618c-1472-4888-8834-67e3f6e6d1e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:58.196558 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0ff5618c-1472-4888-8834-67e3f6e6d1e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:58.197260 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0ff5618c-1472-4888-8834-67e3f6e6d1e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:58.197849 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0ff5618c-1472-4888-8834-67e3f6e6d1e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:58.198560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0ff5618c-1472-4888-8834-67e3f6e6d1e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:58.199014 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0ff5618c-1472-4888-8834-67e3f6e6d1e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:58.199438 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0ff5618c-1472-4888-8834-67e3f6e6d1e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:58.286276 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0ff5618c-1472-4888-8834-67e3f6e6d1e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102294 Aug 18 11:03:58.286857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 108/206] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Aug 18 11:03:58 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:03:58.467358 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6d744aff-90f2-46dc-a417-6f9fe379ede8 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:58.468058 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6d744aff-90f2-46dc-a417-6f9fe379ede8 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:58.476174 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d744aff-90f2-46dc-a417-6f9fe379ede8 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:58.476740 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d744aff-90f2-46dc-a417-6f9fe379ede8 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:58.477251 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d744aff-90f2-46dc-a417-6f9fe379ede8 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:58.478136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d744aff-90f2-46dc-a417-6f9fe379ede8 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:58.478713 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d744aff-90f2-46dc-a417-6f9fe379ede8 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:58.479270 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d744aff-90f2-46dc-a417-6f9fe379ede8 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:58.645487 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6d744aff-90f2-46dc-a417-6f9fe379ede8 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:58.654822 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6d744aff-90f2-46dc-a417-6f9fe379ede8 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.191294 Aug 18 11:03:58.655551 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 99/207] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:58 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:58.955742 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-cd5ebffc-2459-4eb7-8263-5b360a10cf78 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:58.956923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-cd5ebffc-2459-4eb7-8263-5b360a10cf78 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:58.965257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cd5ebffc-2459-4eb7-8263-5b360a10cf78 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:58.966003 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cd5ebffc-2459-4eb7-8263-5b360a10cf78 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:58.966757 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cd5ebffc-2459-4eb7-8263-5b360a10cf78 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:58.967697 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cd5ebffc-2459-4eb7-8263-5b360a10cf78 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:58.968416 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cd5ebffc-2459-4eb7-8263-5b360a10cf78 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:58.969041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cd5ebffc-2459-4eb7-8263-5b360a10cf78 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:59.251545 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cd5ebffc-2459-4eb7-8263-5b360a10cf78 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:59.263869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-cd5ebffc-2459-4eb7-8263-5b360a10cf78 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.311876 Aug 18 11:03:59.264579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 109/208] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:58 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:03:59.447653 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-e1fac124-6faf-454e-9d9f-8df01e702d6d req-6d105f82-a7ee-4b38-8302-c8599f07e6bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36caff1-93fb-4fd8-8727-9aa6b23ee576", "tag": "d14edd58-652d-4c9e-b988-a4e1b455c2b1"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:03:59.459243 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e1fac124-6faf-454e-9d9f-8df01e702d6d req-6d105f82-a7ee-4b38-8302-c8599f07e6bb service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:59.459762 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e1fac124-6faf-454e-9d9f-8df01e702d6d req-6d105f82-a7ee-4b38-8302-c8599f07e6bb service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:59.460259 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e1fac124-6faf-454e-9d9f-8df01e702d6d req-6d105f82-a7ee-4b38-8302-c8599f07e6bb service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:59.475127 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-e1fac124-6faf-454e-9d9f-8df01e702d6d req-6d105f82-a7ee-4b38-8302-c8599f07e6bb service nova] Creating event network-changed:d14edd58-652d-4c9e-b988-a4e1b455c2b1 for instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 on hv-cinder-82660 Aug 18 11:03:59.482322 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-e1fac124-6faf-454e-9d9f-8df01e702d6d req-6d105f82-a7ee-4b38-8302-c8599f07e6bb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038250 Aug 18 11:03:59.486465 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 100/209] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:03:59.676833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b35d7f38-b55d-493a-8685-00536adb57c0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:03:59.677454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b35d7f38-b55d-493a-8685-00536adb57c0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:03:59.683806 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b35d7f38-b55d-493a-8685-00536adb57c0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:59.684591 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b35d7f38-b55d-493a-8685-00536adb57c0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:59.685232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b35d7f38-b55d-493a-8685-00536adb57c0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:59.686190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b35d7f38-b55d-493a-8685-00536adb57c0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:03:59.686915 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b35d7f38-b55d-493a-8685-00536adb57c0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:03:59.687540 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b35d7f38-b55d-493a-8685-00536adb57c0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:03:59.854698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b35d7f38-b55d-493a-8685-00536adb57c0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:03:59.864148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b35d7f38-b55d-493a-8685-00536adb57c0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.191754 Aug 18 11:03:59.866336 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 110/210] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:03:59 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:00.289693 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6a001751-72fe-471e-978d-beb9023a25a1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:00.291113 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6a001751-72fe-471e-978d-beb9023a25a1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:00.304852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a001751-72fe-471e-978d-beb9023a25a1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:00.305605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a001751-72fe-471e-978d-beb9023a25a1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:00.306270 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a001751-72fe-471e-978d-beb9023a25a1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:00.307184 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a001751-72fe-471e-978d-beb9023a25a1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:00.308660 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a001751-72fe-471e-978d-beb9023a25a1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:00.309796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a001751-72fe-471e-978d-beb9023a25a1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:00.580954 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6a001751-72fe-471e-978d-beb9023a25a1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:00.593065 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6a001751-72fe-471e-978d-beb9023a25a1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.309642 Aug 18 11:04:00.607242 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 101/211] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:00 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:00.887306 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-df506d25-da49-4e39-86f5-9bdc79c5a6fe tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:00.887918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-df506d25-da49-4e39-86f5-9bdc79c5a6fe tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:00.894514 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df506d25-da49-4e39-86f5-9bdc79c5a6fe tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:00.895036 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df506d25-da49-4e39-86f5-9bdc79c5a6fe tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:00.896118 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df506d25-da49-4e39-86f5-9bdc79c5a6fe tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:00.896874 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df506d25-da49-4e39-86f5-9bdc79c5a6fe tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:00.897529 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df506d25-da49-4e39-86f5-9bdc79c5a6fe tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:00.898579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df506d25-da49-4e39-86f5-9bdc79c5a6fe tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:01.048484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-df506d25-da49-4e39-86f5-9bdc79c5a6fe tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:01.056243 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-df506d25-da49-4e39-86f5-9bdc79c5a6fe tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.173113 Aug 18 11:04:01.056824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 111/212] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:00 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:01.615279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b791399d-3b7c-491f-86d0-d9055d38c01b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:01.615939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b791399d-3b7c-491f-86d0-d9055d38c01b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:01.622520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b791399d-3b7c-491f-86d0-d9055d38c01b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:01.623344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b791399d-3b7c-491f-86d0-d9055d38c01b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:01.624062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b791399d-3b7c-491f-86d0-d9055d38c01b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:01.624981 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b791399d-3b7c-491f-86d0-d9055d38c01b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:01.625579 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b791399d-3b7c-491f-86d0-d9055d38c01b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:01.625994 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b791399d-3b7c-491f-86d0-d9055d38c01b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:01.768936 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b791399d-3b7c-491f-86d0-d9055d38c01b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:01.776984 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b791399d-3b7c-491f-86d0-d9055d38c01b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.166254 Aug 18 11:04:01.777634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 102/213] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:01 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:02.076544 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-516f8ca4-de48-4dd1-ad69-498b0900ecfc tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:02.077301 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-516f8ca4-de48-4dd1-ad69-498b0900ecfc tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:02.085350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-516f8ca4-de48-4dd1-ad69-498b0900ecfc tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:02.085350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-516f8ca4-de48-4dd1-ad69-498b0900ecfc tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:02.085350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-516f8ca4-de48-4dd1-ad69-498b0900ecfc tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:02.085891 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-516f8ca4-de48-4dd1-ad69-498b0900ecfc tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:02.086447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-516f8ca4-de48-4dd1-ad69-498b0900ecfc tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:02.086772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-516f8ca4-de48-4dd1-ad69-498b0900ecfc tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:02.231118 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-516f8ca4-de48-4dd1-ad69-498b0900ecfc tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:02.239428 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-516f8ca4-de48-4dd1-ad69-498b0900ecfc tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.166069 Aug 18 11:04:02.240018 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 112/214] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:02 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:02.798472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9eb7dd26-050f-4bd6-8aeb-1d07a3321e63 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:02.799112 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9eb7dd26-050f-4bd6-8aeb-1d07a3321e63 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:02.805816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9eb7dd26-050f-4bd6-8aeb-1d07a3321e63 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:02.806295 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9eb7dd26-050f-4bd6-8aeb-1d07a3321e63 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:02.806722 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9eb7dd26-050f-4bd6-8aeb-1d07a3321e63 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:02.807408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9eb7dd26-050f-4bd6-8aeb-1d07a3321e63 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:02.807855 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9eb7dd26-050f-4bd6-8aeb-1d07a3321e63 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:02.808271 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9eb7dd26-050f-4bd6-8aeb-1d07a3321e63 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:02.965168 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9eb7dd26-050f-4bd6-8aeb-1d07a3321e63 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:02.973567 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9eb7dd26-050f-4bd6-8aeb-1d07a3321e63 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.178553 Aug 18 11:04:02.974881 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 103/215] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:02 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:03.260171 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-23c69e4e-bd36-417c-9edd-a42fdbbc2bde tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:03.260773 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-23c69e4e-bd36-417c-9edd-a42fdbbc2bde tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:03.267082 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-23c69e4e-bd36-417c-9edd-a42fdbbc2bde tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:03.267572 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-23c69e4e-bd36-417c-9edd-a42fdbbc2bde tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:03.268028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-23c69e4e-bd36-417c-9edd-a42fdbbc2bde tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:03.268703 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-23c69e4e-bd36-417c-9edd-a42fdbbc2bde tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:03.269197 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-23c69e4e-bd36-417c-9edd-a42fdbbc2bde tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:03.270745 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-23c69e4e-bd36-417c-9edd-a42fdbbc2bde tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:03.407084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-23c69e4e-bd36-417c-9edd-a42fdbbc2bde tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:03.418351 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-23c69e4e-bd36-417c-9edd-a42fdbbc2bde tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.161886 Aug 18 11:04:03.418916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 113/216] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:03 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:03.998809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-36d25cba-1cba-4b38-900d-992d7cd241fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:03.999416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-36d25cba-1cba-4b38-900d-992d7cd241fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:04.006858 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36d25cba-1cba-4b38-900d-992d7cd241fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:04.007345 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36d25cba-1cba-4b38-900d-992d7cd241fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:04.007797 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36d25cba-1cba-4b38-900d-992d7cd241fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:04.008475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36d25cba-1cba-4b38-900d-992d7cd241fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:04.008931 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36d25cba-1cba-4b38-900d-992d7cd241fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:04.009358 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36d25cba-1cba-4b38-900d-992d7cd241fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:04.151440 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-36d25cba-1cba-4b38-900d-992d7cd241fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:04.159132 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-36d25cba-1cba-4b38-900d-992d7cd241fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.164193 Aug 18 11:04:04.159746 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 104/217] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:03 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:04.442121 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bca7a191-9bfa-4f0f-81b2-f6e093394830 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:04.442805 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bca7a191-9bfa-4f0f-81b2-f6e093394830 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:04.449682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bca7a191-9bfa-4f0f-81b2-f6e093394830 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:04.450321 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bca7a191-9bfa-4f0f-81b2-f6e093394830 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:04.451039 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bca7a191-9bfa-4f0f-81b2-f6e093394830 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:04.451947 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bca7a191-9bfa-4f0f-81b2-f6e093394830 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:04.452728 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bca7a191-9bfa-4f0f-81b2-f6e093394830 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:04.453398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bca7a191-9bfa-4f0f-81b2-f6e093394830 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:04.590552 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bca7a191-9bfa-4f0f-81b2-f6e093394830 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:04.599548 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bca7a191-9bfa-4f0f-81b2-f6e093394830 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.161503 Aug 18 11:04:04.600121 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 114/218] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:04 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:05.180140 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8fa589d9-e231-42ea-bab9-8d505ecf437b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:05.180777 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8fa589d9-e231-42ea-bab9-8d505ecf437b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:05.186955 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fa589d9-e231-42ea-bab9-8d505ecf437b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:05.187440 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fa589d9-e231-42ea-bab9-8d505ecf437b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:05.187875 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fa589d9-e231-42ea-bab9-8d505ecf437b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:05.188570 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fa589d9-e231-42ea-bab9-8d505ecf437b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:05.189027 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fa589d9-e231-42ea-bab9-8d505ecf437b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:05.189449 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fa589d9-e231-42ea-bab9-8d505ecf437b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:05.328705 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8fa589d9-e231-42ea-bab9-8d505ecf437b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:05.337464 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8fa589d9-e231-42ea-bab9-8d505ecf437b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.161090 Aug 18 11:04:05.338293 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 105/219] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:05 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:05.623700 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4e57bd4c-7a0e-4ded-9fe7-d1f0eee52686 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:05.624311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4e57bd4c-7a0e-4ded-9fe7-d1f0eee52686 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:05.631485 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4e57bd4c-7a0e-4ded-9fe7-d1f0eee52686 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:05.632286 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4e57bd4c-7a0e-4ded-9fe7-d1f0eee52686 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:05.632742 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4e57bd4c-7a0e-4ded-9fe7-d1f0eee52686 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:05.633699 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4e57bd4c-7a0e-4ded-9fe7-d1f0eee52686 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:05.634175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4e57bd4c-7a0e-4ded-9fe7-d1f0eee52686 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:05.634604 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4e57bd4c-7a0e-4ded-9fe7-d1f0eee52686 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:05.774567 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4e57bd4c-7a0e-4ded-9fe7-d1f0eee52686 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:05.781862 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4e57bd4c-7a0e-4ded-9fe7-d1f0eee52686 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.162125 Aug 18 11:04:05.782440 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 115/220] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:05 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:06.359681 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9ca744eb-3b4c-4499-94ad-7dc8e8d6e6be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:06.360314 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9ca744eb-3b4c-4499-94ad-7dc8e8d6e6be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:06.366910 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ca744eb-3b4c-4499-94ad-7dc8e8d6e6be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:06.367390 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ca744eb-3b4c-4499-94ad-7dc8e8d6e6be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:06.367819 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ca744eb-3b4c-4499-94ad-7dc8e8d6e6be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:06.368511 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ca744eb-3b4c-4499-94ad-7dc8e8d6e6be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:06.368965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ca744eb-3b4c-4499-94ad-7dc8e8d6e6be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:06.369386 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ca744eb-3b4c-4499-94ad-7dc8e8d6e6be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:06.550842 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-5a28f0f6-f198-45f3-9769-d8cc550fd38e req-5b1aa1c1-1f8a-472e-9380-c33773dd0d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a19e95d-516b-457e-8b0f-00794fb8a6e0", "name": "network-vif-plugged", "status": "completed", "tag": "a03dceb4-130c-42d9-b3e6-7ab74008e2be"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:06.561400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9ca744eb-3b4c-4499-94ad-7dc8e8d6e6be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:06.564969 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:06.575770 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-5a28f0f6-f198-45f3-9769-d8cc550fd38e req-5b1aa1c1-1f8a-472e-9380-c33773dd0d32 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:06.576367 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-5a28f0f6-f198-45f3-9769-d8cc550fd38e req-5b1aa1c1-1f8a-472e-9380-c33773dd0d32 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:06.576600 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9ca744eb-3b4c-4499-94ad-7dc8e8d6e6be tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.220982 Aug 18 11:04:06.577280 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-5a28f0f6-f198-45f3-9769-d8cc550fd38e req-5b1aa1c1-1f8a-472e-9380-c33773dd0d32 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:06.577726 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 106/221] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:06 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:06.606602 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-5a28f0f6-f198-45f3-9769-d8cc550fd38e req-5b1aa1c1-1f8a-472e-9380-c33773dd0d32 service nova] Creating event network-vif-plugged:a03dceb4-130c-42d9-b3e6-7ab74008e2be for instance 3a19e95d-516b-457e-8b0f-00794fb8a6e0 on hv-cinder-82660 Aug 18 11:04:06.611789 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-5a28f0f6-f198-45f3-9769-d8cc550fd38e req-5b1aa1c1-1f8a-472e-9380-c33773dd0d32 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064745 Aug 18 11:04:06.613199 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 116/222] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:04:06.804419 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d4f90d3d-e475-43d8-8e41-1c446a51a683 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:06.805036 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d4f90d3d-e475-43d8-8e41-1c446a51a683 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:06.811815 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f90d3d-e475-43d8-8e41-1c446a51a683 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:06.812543 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f90d3d-e475-43d8-8e41-1c446a51a683 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:06.812977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f90d3d-e475-43d8-8e41-1c446a51a683 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:06.814016 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f90d3d-e475-43d8-8e41-1c446a51a683 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:06.814472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f90d3d-e475-43d8-8e41-1c446a51a683 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:06.814900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f90d3d-e475-43d8-8e41-1c446a51a683 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:06.963376 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d4f90d3d-e475-43d8-8e41-1c446a51a683 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:06.973005 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d4f90d3d-e475-43d8-8e41-1c446a51a683 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.173457 Aug 18 11:04:06.973779 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 107/223] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:06 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:07.601697 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-26dfaf50-68eb-4620-b339-94e4788d8c5d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:07.602409 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-26dfaf50-68eb-4620-b339-94e4788d8c5d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:07.608462 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26dfaf50-68eb-4620-b339-94e4788d8c5d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:07.609076 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26dfaf50-68eb-4620-b339-94e4788d8c5d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:07.609537 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26dfaf50-68eb-4620-b339-94e4788d8c5d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:07.610223 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26dfaf50-68eb-4620-b339-94e4788d8c5d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:07.610671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26dfaf50-68eb-4620-b339-94e4788d8c5d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:07.611090 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26dfaf50-68eb-4620-b339-94e4788d8c5d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:07.755130 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-26dfaf50-68eb-4620-b339-94e4788d8c5d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:07.770247 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-26dfaf50-68eb-4620-b339-94e4788d8c5d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.166846 Aug 18 11:04:07.770247 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 117/224] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:07 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:07.777505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-cb457874-c5de-499d-a0a7-fdcf2c7f38ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:07.778026 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-cb457874-c5de-499d-a0a7-fdcf2c7f38ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:07.786085 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb457874-c5de-499d-a0a7-fdcf2c7f38ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:07.786640 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb457874-c5de-499d-a0a7-fdcf2c7f38ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:07.787091 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb457874-c5de-499d-a0a7-fdcf2c7f38ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:07.787858 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb457874-c5de-499d-a0a7-fdcf2c7f38ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:07.788325 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb457874-c5de-499d-a0a7-fdcf2c7f38ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:07.788739 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb457874-c5de-499d-a0a7-fdcf2c7f38ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:07.817938 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-cb457874-c5de-499d-a0a7-fdcf2c7f38ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:04:07.908173 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-cb457874-c5de-499d-a0a7-fdcf2c7f38ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 204 len: 0 microversion: 2.1 time: 0.134044 Aug 18 11:04:07.908891 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 108/225] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:04:07 2022] DELETE /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:04:07.918018 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9d2887b3-6cf3-41cf-a3ae-42f9e1e8d7a3 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:07.918665 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9d2887b3-6cf3-41cf-a3ae-42f9e1e8d7a3 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:07.925193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d2887b3-6cf3-41cf-a3ae-42f9e1e8d7a3 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:07.925708 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d2887b3-6cf3-41cf-a3ae-42f9e1e8d7a3 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:07.926200 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d2887b3-6cf3-41cf-a3ae-42f9e1e8d7a3 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:07.926936 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d2887b3-6cf3-41cf-a3ae-42f9e1e8d7a3 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:07.927395 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d2887b3-6cf3-41cf-a3ae-42f9e1e8d7a3 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:07.927819 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d2887b3-6cf3-41cf-a3ae-42f9e1e8d7a3 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:07.994831 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a7d8129f-c059-4f55-bc0e-095e373581a1 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:07.995781 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a7d8129f-c059-4f55-bc0e-095e373581a1 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:08.001777 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7d8129f-c059-4f55-bc0e-095e373581a1 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:08.002262 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7d8129f-c059-4f55-bc0e-095e373581a1 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:08.002698 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7d8129f-c059-4f55-bc0e-095e373581a1 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:08.003485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7d8129f-c059-4f55-bc0e-095e373581a1 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:08.004014 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7d8129f-c059-4f55-bc0e-095e373581a1 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:08.004565 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7d8129f-c059-4f55-bc0e-095e373581a1 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:08.080144 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9d2887b3-6cf3-41cf-a3ae-42f9e1e8d7a3 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:08.090705 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9d2887b3-6cf3-41cf-a3ae-42f9e1e8d7a3 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.176734 Aug 18 11:04:08.091419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 118/226] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:07 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:08.201313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a7d8129f-c059-4f55-bc0e-095e373581a1 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:08.214412 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a7d8129f-c059-4f55-bc0e-095e373581a1 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.224347 Aug 18 11:04:08.215046 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 109/227] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:07 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:08.785597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-55f039b6-c08f-4796-a326-4613d650d498 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:08.786402 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-55f039b6-c08f-4796-a326-4613d650d498 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:08.795600 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55f039b6-c08f-4796-a326-4613d650d498 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:08.796125 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55f039b6-c08f-4796-a326-4613d650d498 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:08.796566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55f039b6-c08f-4796-a326-4613d650d498 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:08.797269 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55f039b6-c08f-4796-a326-4613d650d498 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:08.797758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55f039b6-c08f-4796-a326-4613d650d498 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:08.798177 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-55f039b6-c08f-4796-a326-4613d650d498 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:08.967245 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-55f039b6-c08f-4796-a326-4613d650d498 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:08.976377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-55f039b6-c08f-4796-a326-4613d650d498 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.194858 Aug 18 11:04:08.976960 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 119/228] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:08 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:09.112305 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b3efeb62-73bc-4c04-a56d-0cd67dec21ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:09.113065 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b3efeb62-73bc-4c04-a56d-0cd67dec21ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:09.122088 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3efeb62-73bc-4c04-a56d-0cd67dec21ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:09.122585 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3efeb62-73bc-4c04-a56d-0cd67dec21ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:09.123052 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3efeb62-73bc-4c04-a56d-0cd67dec21ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:09.123759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3efeb62-73bc-4c04-a56d-0cd67dec21ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:09.124215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3efeb62-73bc-4c04-a56d-0cd67dec21ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:09.124645 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3efeb62-73bc-4c04-a56d-0cd67dec21ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:09.236874 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-59b2d19a-91c6-4020-a3ca-5c80f1dbf064 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:09.237743 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-59b2d19a-91c6-4020-a3ca-5c80f1dbf064 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:09.244098 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-59b2d19a-91c6-4020-a3ca-5c80f1dbf064 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:09.244815 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-59b2d19a-91c6-4020-a3ca-5c80f1dbf064 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:09.245410 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-59b2d19a-91c6-4020-a3ca-5c80f1dbf064 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:09.248614 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-59b2d19a-91c6-4020-a3ca-5c80f1dbf064 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:09.248614 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-59b2d19a-91c6-4020-a3ca-5c80f1dbf064 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:09.248614 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-59b2d19a-91c6-4020-a3ca-5c80f1dbf064 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:09.303939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b3efeb62-73bc-4c04-a56d-0cd67dec21ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:09.315234 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b3efeb62-73bc-4c04-a56d-0cd67dec21ff tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.206776 Aug 18 11:04:09.316132 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 110/229] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:09 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:09.397283 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-59b2d19a-91c6-4020-a3ca-5c80f1dbf064 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:09.405293 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-59b2d19a-91c6-4020-a3ca-5c80f1dbf064 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.173023 Aug 18 11:04:09.405969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 120/230] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:09 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:09.998035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3fcfe1ec-f493-4ee8-b6d1-fd1486c0a014 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:09.998903 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3fcfe1ec-f493-4ee8-b6d1-fd1486c0a014 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:10.004759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3fcfe1ec-f493-4ee8-b6d1-fd1486c0a014 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:10.005240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3fcfe1ec-f493-4ee8-b6d1-fd1486c0a014 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:10.005713 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3fcfe1ec-f493-4ee8-b6d1-fd1486c0a014 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:10.006533 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3fcfe1ec-f493-4ee8-b6d1-fd1486c0a014 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:10.006996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3fcfe1ec-f493-4ee8-b6d1-fd1486c0a014 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:10.007422 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3fcfe1ec-f493-4ee8-b6d1-fd1486c0a014 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:10.150362 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3fcfe1ec-f493-4ee8-b6d1-fd1486c0a014 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:10.158282 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3fcfe1ec-f493-4ee8-b6d1-fd1486c0a014 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.164173 Aug 18 11:04:10.158842 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 111/231] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:09 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:10.337501 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a6b22d3c-eed9-47d4-afd3-333287b0f3da tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:10.338111 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a6b22d3c-eed9-47d4-afd3-333287b0f3da tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:10.344538 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a6b22d3c-eed9-47d4-afd3-333287b0f3da tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:10.345021 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a6b22d3c-eed9-47d4-afd3-333287b0f3da tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:10.345447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a6b22d3c-eed9-47d4-afd3-333287b0f3da tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:10.346350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a6b22d3c-eed9-47d4-afd3-333287b0f3da tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:10.346801 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a6b22d3c-eed9-47d4-afd3-333287b0f3da tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:10.347440 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a6b22d3c-eed9-47d4-afd3-333287b0f3da tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:10.428678 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8a6dd556-9267-449a-a8cf-7d0be21ee6a9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:10.429470 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8a6dd556-9267-449a-a8cf-7d0be21ee6a9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:10.440338 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a6dd556-9267-449a-a8cf-7d0be21ee6a9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:10.440977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a6dd556-9267-449a-a8cf-7d0be21ee6a9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:10.443351 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a6dd556-9267-449a-a8cf-7d0be21ee6a9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:10.444557 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a6dd556-9267-449a-a8cf-7d0be21ee6a9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:10.448256 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a6dd556-9267-449a-a8cf-7d0be21ee6a9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:10.448793 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a6dd556-9267-449a-a8cf-7d0be21ee6a9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:10.561761 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a6b22d3c-eed9-47d4-afd3-333287b0f3da tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:10.573305 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a6b22d3c-eed9-47d4-afd3-333287b0f3da tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.240171 Aug 18 11:04:10.573949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 121/232] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:10 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:10.655792 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8a6dd556-9267-449a-a8cf-7d0be21ee6a9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:10.666218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8a6dd556-9267-449a-a8cf-7d0be21ee6a9 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.242765 Aug 18 11:04:10.667278 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 112/233] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:10 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:11.180304 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-12bceccf-7c8c-4259-80e8-5de708675e65 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:11.180908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-12bceccf-7c8c-4259-80e8-5de708675e65 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:11.187001 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-12bceccf-7c8c-4259-80e8-5de708675e65 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:11.187538 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-12bceccf-7c8c-4259-80e8-5de708675e65 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:11.187983 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-12bceccf-7c8c-4259-80e8-5de708675e65 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:11.188723 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-12bceccf-7c8c-4259-80e8-5de708675e65 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:11.189174 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-12bceccf-7c8c-4259-80e8-5de708675e65 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:11.189633 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-12bceccf-7c8c-4259-80e8-5de708675e65 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:11.205439 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=100 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:11.339087 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-12bceccf-7c8c-4259-80e8-5de708675e65 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:11.348837 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-12bceccf-7c8c-4259-80e8-5de708675e65 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.171977 Aug 18 11:04:11.349473 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 122/234] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:11 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:11.596039 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c2c1a3c6-3fc7-4c39-a428-e2117b7df265 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:11.596707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c2c1a3c6-3fc7-4c39-a428-e2117b7df265 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:11.609005 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2c1a3c6-3fc7-4c39-a428-e2117b7df265 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:11.609423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2c1a3c6-3fc7-4c39-a428-e2117b7df265 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:11.609907 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2c1a3c6-3fc7-4c39-a428-e2117b7df265 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:11.610620 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2c1a3c6-3fc7-4c39-a428-e2117b7df265 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:11.611080 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2c1a3c6-3fc7-4c39-a428-e2117b7df265 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:11.611538 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2c1a3c6-3fc7-4c39-a428-e2117b7df265 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:11.689640 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fb3df469-b41f-4793-8657-203140af6e3e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:11.690464 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fb3df469-b41f-4793-8657-203140af6e3e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:11.696732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb3df469-b41f-4793-8657-203140af6e3e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:11.697225 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb3df469-b41f-4793-8657-203140af6e3e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:11.697713 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb3df469-b41f-4793-8657-203140af6e3e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:11.698514 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb3df469-b41f-4793-8657-203140af6e3e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:11.699000 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb3df469-b41f-4793-8657-203140af6e3e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:11.699434 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb3df469-b41f-4793-8657-203140af6e3e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:11.748113 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c2c1a3c6-3fc7-4c39-a428-e2117b7df265 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:11.760600 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c2c1a3c6-3fc7-4c39-a428-e2117b7df265 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.168257 Aug 18 11:04:11.761900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 113/235] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:11 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:11.846932 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-fb3df469-b41f-4793-8657-203140af6e3e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:11.855267 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fb3df469-b41f-4793-8657-203140af6e3e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.169595 Aug 18 11:04:11.855828 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 123/236] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:11 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:12.372081 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f7052358-dc31-4234-9f52-2000534a12dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:12.373127 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f7052358-dc31-4234-9f52-2000534a12dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:12.381065 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f7052358-dc31-4234-9f52-2000534a12dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:12.381558 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f7052358-dc31-4234-9f52-2000534a12dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:12.381992 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f7052358-dc31-4234-9f52-2000534a12dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:12.382792 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f7052358-dc31-4234-9f52-2000534a12dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:12.383418 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f7052358-dc31-4234-9f52-2000534a12dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:12.383888 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f7052358-dc31-4234-9f52-2000534a12dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:12.561552 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f7052358-dc31-4234-9f52-2000534a12dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:12.571462 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f7052358-dc31-4234-9f52-2000534a12dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.204809 Aug 18 11:04:12.574406 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 114/237] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:12 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:12.783918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e1bf2764-792b-471c-8f63-9c1bd2f0df8d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:12.784588 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e1bf2764-792b-471c-8f63-9c1bd2f0df8d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:12.793826 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e1bf2764-792b-471c-8f63-9c1bd2f0df8d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:12.794479 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e1bf2764-792b-471c-8f63-9c1bd2f0df8d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:12.795046 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e1bf2764-792b-471c-8f63-9c1bd2f0df8d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:12.795829 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e1bf2764-792b-471c-8f63-9c1bd2f0df8d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:12.796350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e1bf2764-792b-471c-8f63-9c1bd2f0df8d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:12.796904 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e1bf2764-792b-471c-8f63-9c1bd2f0df8d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:12.876071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9481def9-e795-4748-9f9d-ecc94c41ca10 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:12.876753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9481def9-e795-4748-9f9d-ecc94c41ca10 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:12.885554 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9481def9-e795-4748-9f9d-ecc94c41ca10 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:12.886203 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9481def9-e795-4748-9f9d-ecc94c41ca10 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:12.887471 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9481def9-e795-4748-9f9d-ecc94c41ca10 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:12.888484 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9481def9-e795-4748-9f9d-ecc94c41ca10 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:12.889116 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9481def9-e795-4748-9f9d-ecc94c41ca10 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:12.890538 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9481def9-e795-4748-9f9d-ecc94c41ca10 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:12.971974 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e1bf2764-792b-471c-8f63-9c1bd2f0df8d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:12.981236 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e1bf2764-792b-471c-8f63-9c1bd2f0df8d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.201181 Aug 18 11:04:12.981847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 124/238] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:12 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:13.054830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9481def9-e795-4748-9f9d-ecc94c41ca10 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:13.062878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9481def9-e795-4748-9f9d-ecc94c41ca10 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.191537 Aug 18 11:04:13.063551 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 115/239] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:12 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:13.595886 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9d7106b2-86ec-4db8-b320-be388957081b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:13.598123 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9d7106b2-86ec-4db8-b320-be388957081b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:13.608186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d7106b2-86ec-4db8-b320-be388957081b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:13.609034 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d7106b2-86ec-4db8-b320-be388957081b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:13.609738 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d7106b2-86ec-4db8-b320-be388957081b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:13.611133 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d7106b2-86ec-4db8-b320-be388957081b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:13.611833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d7106b2-86ec-4db8-b320-be388957081b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:13.612480 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d7106b2-86ec-4db8-b320-be388957081b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:13.840093 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9d7106b2-86ec-4db8-b320-be388957081b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:13.852295 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9d7106b2-86ec-4db8-b320-be388957081b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1522 microversion: 2.1 time: 0.260682 Aug 18 11:04:13.853575 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 125/240] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:13 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:14.004231 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2948e29e-fe9c-4a46-99c8-872f83182889 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:14.005445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2948e29e-fe9c-4a46-99c8-872f83182889 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:14.011672 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2948e29e-fe9c-4a46-99c8-872f83182889 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:14.012143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2948e29e-fe9c-4a46-99c8-872f83182889 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:14.012570 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2948e29e-fe9c-4a46-99c8-872f83182889 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:14.013254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2948e29e-fe9c-4a46-99c8-872f83182889 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:14.013731 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2948e29e-fe9c-4a46-99c8-872f83182889 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:14.014302 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2948e29e-fe9c-4a46-99c8-872f83182889 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:14.085040 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0f8a7d09-ba9d-4945-a659-db4739a3e137 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:14.085681 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0f8a7d09-ba9d-4945-a659-db4739a3e137 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:14.100443 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f8a7d09-ba9d-4945-a659-db4739a3e137 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:14.100956 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f8a7d09-ba9d-4945-a659-db4739a3e137 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:14.101442 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f8a7d09-ba9d-4945-a659-db4739a3e137 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:14.102244 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f8a7d09-ba9d-4945-a659-db4739a3e137 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:14.107348 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f8a7d09-ba9d-4945-a659-db4739a3e137 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:14.107797 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f8a7d09-ba9d-4945-a659-db4739a3e137 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:14.195722 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2948e29e-fe9c-4a46-99c8-872f83182889 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:14.211858 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2948e29e-fe9c-4a46-99c8-872f83182889 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.212563 Aug 18 11:04:14.212472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 116/241] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:13 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:14.273147 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0f8a7d09-ba9d-4945-a659-db4739a3e137 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:14.282617 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0f8a7d09-ba9d-4945-a659-db4739a3e137 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.201837 Aug 18 11:04:14.283442 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 126/242] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:14 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:14.876139 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-aad66073-8a41-4e42-8083-eb8398089939 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:14.876872 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-aad66073-8a41-4e42-8083-eb8398089939 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:14.884213 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aad66073-8a41-4e42-8083-eb8398089939 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:14.884787 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aad66073-8a41-4e42-8083-eb8398089939 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:14.885287 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aad66073-8a41-4e42-8083-eb8398089939 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:14.886182 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aad66073-8a41-4e42-8083-eb8398089939 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:14.886642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aad66073-8a41-4e42-8083-eb8398089939 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:14.887161 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aad66073-8a41-4e42-8083-eb8398089939 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:15.033264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-aad66073-8a41-4e42-8083-eb8398089939 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:15.045375 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-aad66073-8a41-4e42-8083-eb8398089939 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1502 microversion: 2.1 time: 0.173058 Aug 18 11:04:15.046070 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 117/243] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:14 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:15.068121 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-480ffffd-de23-465a-9c48-cae6dcfd7fec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:15.068752 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-480ffffd-de23-465a-9c48-cae6dcfd7fec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:15.085058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-480ffffd-de23-465a-9c48-cae6dcfd7fec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:15.085982 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-480ffffd-de23-465a-9c48-cae6dcfd7fec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:15.086670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-480ffffd-de23-465a-9c48-cae6dcfd7fec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:15.087867 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-480ffffd-de23-465a-9c48-cae6dcfd7fec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:15.088337 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-480ffffd-de23-465a-9c48-cae6dcfd7fec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:15.088766 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-480ffffd-de23-465a-9c48-cae6dcfd7fec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:15.235309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9b055913-55e0-4544-ada2-842596944d0a tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:15.236485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9b055913-55e0-4544-ada2-842596944d0a tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:15.250035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b055913-55e0-4544-ada2-842596944d0a tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:15.250930 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b055913-55e0-4544-ada2-842596944d0a tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:15.251818 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b055913-55e0-4544-ada2-842596944d0a tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:15.253018 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b055913-55e0-4544-ada2-842596944d0a tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:15.254486 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b055913-55e0-4544-ada2-842596944d0a tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:15.255119 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-480ffffd-de23-465a-9c48-cae6dcfd7fec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:15.257870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b055913-55e0-4544-ada2-842596944d0a tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:15.264319 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-480ffffd-de23-465a-9c48-cae6dcfd7fec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1517 microversion: 2.1 time: 0.201323 Aug 18 11:04:15.264968 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 127/244] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:15 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:15.308583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b7219ec0-322c-4269-a84e-33f15e396efa tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:15.309425 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b7219ec0-322c-4269-a84e-33f15e396efa tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:15.321276 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b7219ec0-322c-4269-a84e-33f15e396efa tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:15.321809 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b7219ec0-322c-4269-a84e-33f15e396efa tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:15.322240 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b7219ec0-322c-4269-a84e-33f15e396efa tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:15.322937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b7219ec0-322c-4269-a84e-33f15e396efa tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:15.323385 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b7219ec0-322c-4269-a84e-33f15e396efa tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:15.323805 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b7219ec0-322c-4269-a84e-33f15e396efa tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:15.476034 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9b055913-55e0-4544-ada2-842596944d0a tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:15.486161 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9b055913-55e0-4544-ada2-842596944d0a tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.256510 Aug 18 11:04:15.505165 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 118/245] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:15 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:15.508731 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b7219ec0-322c-4269-a84e-33f15e396efa tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:15.520011 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b7219ec0-322c-4269-a84e-33f15e396efa tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.214588 Aug 18 11:04:15.531117 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 128/246] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:15 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:16.514306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f79295c9-8f95-45c1-9c46-71ab31e1c59d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:16.514919 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f79295c9-8f95-45c1-9c46-71ab31e1c59d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:16.517347 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:16.522983 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f79295c9-8f95-45c1-9c46-71ab31e1c59d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:16.523471 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f79295c9-8f95-45c1-9c46-71ab31e1c59d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:16.523907 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f79295c9-8f95-45c1-9c46-71ab31e1c59d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:16.524604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f79295c9-8f95-45c1-9c46-71ab31e1c59d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:16.525108 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f79295c9-8f95-45c1-9c46-71ab31e1c59d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:16.525459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f79295c9-8f95-45c1-9c46-71ab31e1c59d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:16.544611 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-32a5cbed-5662-48d9-900a-04dfc01e4d40 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:16.545773 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-32a5cbed-5662-48d9-900a-04dfc01e4d40 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:16.552532 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=98 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:16.554329 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-32a5cbed-5662-48d9-900a-04dfc01e4d40 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:16.555034 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-32a5cbed-5662-48d9-900a-04dfc01e4d40 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:16.555659 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-32a5cbed-5662-48d9-900a-04dfc01e4d40 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:16.556511 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-32a5cbed-5662-48d9-900a-04dfc01e4d40 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:16.557213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-32a5cbed-5662-48d9-900a-04dfc01e4d40 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:16.557812 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-32a5cbed-5662-48d9-900a-04dfc01e4d40 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:16.691866 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f79295c9-8f95-45c1-9c46-71ab31e1c59d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:16.699983 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f79295c9-8f95-45c1-9c46-71ab31e1c59d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.189393 Aug 18 11:04:16.700564 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 119/247] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:16 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:16.723904 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-32a5cbed-5662-48d9-900a-04dfc01e4d40 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:16.731320 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-32a5cbed-5662-48d9-900a-04dfc01e4d40 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.190576 Aug 18 11:04:16.732148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 129/248] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:16 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:17.721903 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2cf260ce-c75f-4171-afed-d487e2f80665 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:17.724149 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2cf260ce-c75f-4171-afed-d487e2f80665 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:17.730838 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2cf260ce-c75f-4171-afed-d487e2f80665 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:17.731324 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2cf260ce-c75f-4171-afed-d487e2f80665 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:17.731930 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2cf260ce-c75f-4171-afed-d487e2f80665 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:17.732803 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2cf260ce-c75f-4171-afed-d487e2f80665 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:17.733408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2cf260ce-c75f-4171-afed-d487e2f80665 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:17.734004 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2cf260ce-c75f-4171-afed-d487e2f80665 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:17.754054 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d3531735-d610-4b61-b3b4-7be2168d0703 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:17.754670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d3531735-d610-4b61-b3b4-7be2168d0703 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:17.763387 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d3531735-d610-4b61-b3b4-7be2168d0703 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:17.764157 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d3531735-d610-4b61-b3b4-7be2168d0703 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:17.764861 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d3531735-d610-4b61-b3b4-7be2168d0703 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:17.766003 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d3531735-d610-4b61-b3b4-7be2168d0703 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:17.766599 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d3531735-d610-4b61-b3b4-7be2168d0703 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:17.767179 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d3531735-d610-4b61-b3b4-7be2168d0703 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:17.934955 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2cf260ce-c75f-4171-afed-d487e2f80665 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:17.943880 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2cf260ce-c75f-4171-afed-d487e2f80665 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.225882 Aug 18 11:04:17.944450 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 120/249] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:17 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:17.950654 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-60183643-372c-478b-b5b6-3c0d79426788 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:17.953021 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-60183643-372c-478b-b5b6-3c0d79426788 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:17.960801 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-60183643-372c-478b-b5b6-3c0d79426788 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:17.961478 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-60183643-372c-478b-b5b6-3c0d79426788 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:17.962130 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-60183643-372c-478b-b5b6-3c0d79426788 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:17.963157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-60183643-372c-478b-b5b6-3c0d79426788 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:17.963636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-60183643-372c-478b-b5b6-3c0d79426788 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:17.964251 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-60183643-372c-478b-b5b6-3c0d79426788 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:18.001300 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-d3531735-d610-4b61-b3b4-7be2168d0703 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:18.002994 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-60183643-372c-478b-b5b6-3c0d79426788 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lazy-loading 'flavor' on Instance uuid 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:04:18.017361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-d3531735-d610-4b61-b3b4-7be2168d0703 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1313 microversion: 2.1 time: 0.268589 Aug 18 11:04:18.022055 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 130/250] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:17 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:18.065628 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:18.189923 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-60183643-372c-478b-b5b6-3c0d79426788 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762/action" status: 200 len: 32 microversion: 2.1 time: 0.244045 Aug 18 11:04:18.190437 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 121/251] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:04:17 2022] POST /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:04:18.200999 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3bef2e72-1edc-49fb-b90d-fcdc129a3470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:18.201732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3bef2e72-1edc-49fb-b90d-fcdc129a3470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:18.208377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bef2e72-1edc-49fb-b90d-fcdc129a3470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:18.208861 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bef2e72-1edc-49fb-b90d-fcdc129a3470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:18.209300 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bef2e72-1edc-49fb-b90d-fcdc129a3470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:18.210046 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bef2e72-1edc-49fb-b90d-fcdc129a3470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:18.210498 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bef2e72-1edc-49fb-b90d-fcdc129a3470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:18.210924 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bef2e72-1edc-49fb-b90d-fcdc129a3470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:18.339872 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3bef2e72-1edc-49fb-b90d-fcdc129a3470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:18.347865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3bef2e72-1edc-49fb-b90d-fcdc129a3470 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.150697 Aug 18 11:04:18.348605 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 131/252] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:18 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:18.983550 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-653aea90-e1cc-4f62-b8e7-1d9e025f7a2d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:18.984242 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-653aea90-e1cc-4f62-b8e7-1d9e025f7a2d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:18.991815 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-653aea90-e1cc-4f62-b8e7-1d9e025f7a2d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:18.992222 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-653aea90-e1cc-4f62-b8e7-1d9e025f7a2d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:18.992652 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-653aea90-e1cc-4f62-b8e7-1d9e025f7a2d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:18.993329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-653aea90-e1cc-4f62-b8e7-1d9e025f7a2d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:18.993804 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-653aea90-e1cc-4f62-b8e7-1d9e025f7a2d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:18.994222 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-653aea90-e1cc-4f62-b8e7-1d9e025f7a2d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:19.082904 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c2434ab8-11bb-481c-ad59-af998277cbe0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:19.083649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c2434ab8-11bb-481c-ad59-af998277cbe0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:19.090847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c2434ab8-11bb-481c-ad59-af998277cbe0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:19.091341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c2434ab8-11bb-481c-ad59-af998277cbe0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:19.091781 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c2434ab8-11bb-481c-ad59-af998277cbe0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:19.092486 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c2434ab8-11bb-481c-ad59-af998277cbe0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:19.092939 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c2434ab8-11bb-481c-ad59-af998277cbe0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:19.093562 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c2434ab8-11bb-481c-ad59-af998277cbe0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:19.131821 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-653aea90-e1cc-4f62-b8e7-1d9e025f7a2d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:19.140097 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-653aea90-e1cc-4f62-b8e7-1d9e025f7a2d tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.161340 Aug 18 11:04:19.140772 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 122/253] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:18 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:19.230896 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c2434ab8-11bb-481c-ad59-af998277cbe0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:19.239058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c2434ab8-11bb-481c-ad59-af998277cbe0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1497 microversion: 2.1 time: 0.160022 Aug 18 11:04:19.239709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 132/254] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:19 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:19.369783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-425db347-284a-436f-8cfb-7fc57912e799 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:19.370428 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-425db347-284a-436f-8cfb-7fc57912e799 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:19.376726 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-425db347-284a-436f-8cfb-7fc57912e799 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:19.377215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-425db347-284a-436f-8cfb-7fc57912e799 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:19.377689 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-425db347-284a-436f-8cfb-7fc57912e799 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:19.378852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-425db347-284a-436f-8cfb-7fc57912e799 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:19.379592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-425db347-284a-436f-8cfb-7fc57912e799 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:19.380021 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-425db347-284a-436f-8cfb-7fc57912e799 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:19.517431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-425db347-284a-436f-8cfb-7fc57912e799 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:19.525383 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-425db347-284a-436f-8cfb-7fc57912e799 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.159580 Aug 18 11:04:19.525986 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 123/255] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:19 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:20.160911 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f0194c96-0d4f-48d1-883f-f6817fd6eaec tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:20.162059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-f4da2dc0-1998-4583-8cb1-b845c4349ed2 req-4ec3d218-1a42-4c7b-a5c0-f1b5dd58c359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a38c9ed-092c-4a82-9581-85326a84f582", "name": "network-vif-unplugged", "status": "completed", "tag": "4bed2960-285e-436c-92c4-807908aec234"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:20.162510 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f0194c96-0d4f-48d1-883f-f6817fd6eaec tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:20.168940 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f0194c96-0d4f-48d1-883f-f6817fd6eaec tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:20.169414 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f0194c96-0d4f-48d1-883f-f6817fd6eaec tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:20.170031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f0194c96-0d4f-48d1-883f-f6817fd6eaec tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:20.171071 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f0194c96-0d4f-48d1-883f-f6817fd6eaec tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:20.171671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f0194c96-0d4f-48d1-883f-f6817fd6eaec tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:20.172249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f0194c96-0d4f-48d1-883f-f6817fd6eaec tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:20.173291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-f4da2dc0-1998-4583-8cb1-b845c4349ed2 req-4ec3d218-1a42-4c7b-a5c0-f1b5dd58c359 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:20.173877 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-f4da2dc0-1998-4583-8cb1-b845c4349ed2 req-4ec3d218-1a42-4c7b-a5c0-f1b5dd58c359 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:20.174308 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-f4da2dc0-1998-4583-8cb1-b845c4349ed2 req-4ec3d218-1a42-4c7b-a5c0-f1b5dd58c359 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:20.332749 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-f4da2dc0-1998-4583-8cb1-b845c4349ed2 req-4ec3d218-1a42-4c7b-a5c0-f1b5dd58c359 service nova] Creating event network-vif-unplugged:4bed2960-285e-436c-92c4-807908aec234 for instance 9a38c9ed-092c-4a82-9581-85326a84f582 on hv-cinder-82660 Aug 18 11:04:20.337882 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-f4da2dc0-1998-4583-8cb1-b845c4349ed2 req-4ec3d218-1a42-4c7b-a5c0-f1b5dd58c359 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180240 Aug 18 11:04:20.338419 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 124/256] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:04:20.346760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f0194c96-0d4f-48d1-883f-f6817fd6eaec tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:20.355070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f0194c96-0d4f-48d1-883f-f6817fd6eaec tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.198837 Aug 18 11:04:20.355628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 133/257] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:20 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:20.548285 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-895f7549-112c-4c2f-82eb-24dda27aacd9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:20.549108 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-895f7549-112c-4c2f-82eb-24dda27aacd9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:20.556284 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-895f7549-112c-4c2f-82eb-24dda27aacd9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:20.556878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-895f7549-112c-4c2f-82eb-24dda27aacd9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:20.557433 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-895f7549-112c-4c2f-82eb-24dda27aacd9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:20.558237 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-895f7549-112c-4c2f-82eb-24dda27aacd9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:20.558737 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-895f7549-112c-4c2f-82eb-24dda27aacd9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:20.559261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-895f7549-112c-4c2f-82eb-24dda27aacd9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:20.698658 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-895f7549-112c-4c2f-82eb-24dda27aacd9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:20.706273 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-895f7549-112c-4c2f-82eb-24dda27aacd9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.163057 Aug 18 11:04:20.706830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 125/258] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:20 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:21.376085 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7a2cd9fe-bb64-4bee-8205-91d9b3e46d9e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:21.376679 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7a2cd9fe-bb64-4bee-8205-91d9b3e46d9e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:21.382962 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a2cd9fe-bb64-4bee-8205-91d9b3e46d9e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:21.383440 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a2cd9fe-bb64-4bee-8205-91d9b3e46d9e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:21.383869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a2cd9fe-bb64-4bee-8205-91d9b3e46d9e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:21.384560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a2cd9fe-bb64-4bee-8205-91d9b3e46d9e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:21.385009 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a2cd9fe-bb64-4bee-8205-91d9b3e46d9e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:21.385422 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a2cd9fe-bb64-4bee-8205-91d9b3e46d9e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:21.522338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7a2cd9fe-bb64-4bee-8205-91d9b3e46d9e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:21.530466 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7a2cd9fe-bb64-4bee-8205-91d9b3e46d9e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1554 microversion: 2.1 time: 0.158139 Aug 18 11:04:21.531041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 134/259] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:21 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:21.712738 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-37fcdb93-62c0-46e3-b4bf-9b34cff7bf05 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:21.713268 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-37fcdb93-62c0-46e3-b4bf-9b34cff7bf05 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:21.719994 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37fcdb93-62c0-46e3-b4bf-9b34cff7bf05 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:21.720471 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37fcdb93-62c0-46e3-b4bf-9b34cff7bf05 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:21.721357 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37fcdb93-62c0-46e3-b4bf-9b34cff7bf05 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:21.722211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37fcdb93-62c0-46e3-b4bf-9b34cff7bf05 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:21.722645 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37fcdb93-62c0-46e3-b4bf-9b34cff7bf05 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:21.723380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-37fcdb93-62c0-46e3-b4bf-9b34cff7bf05 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:21.728767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1f1608e4-aa11-4f27-9807-cf2141a0adbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:21.730085 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1f1608e4-aa11-4f27-9807-cf2141a0adbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:21.736635 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f1608e4-aa11-4f27-9807-cf2141a0adbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:21.737360 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f1608e4-aa11-4f27-9807-cf2141a0adbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:21.738467 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f1608e4-aa11-4f27-9807-cf2141a0adbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:21.739173 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f1608e4-aa11-4f27-9807-cf2141a0adbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:21.740032 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f1608e4-aa11-4f27-9807-cf2141a0adbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:21.740610 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1f1608e4-aa11-4f27-9807-cf2141a0adbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:21.750850 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-37fcdb93-62c0-46e3-b4bf-9b34cff7bf05 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:04:21.839749 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-37fcdb93-62c0-46e3-b4bf-9b34cff7bf05 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 204 len: 0 microversion: 2.1 time: 0.130235 Aug 18 11:04:21.840665 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 126/260] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:04:21 2022] DELETE /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:04:21.851219 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-835558ed-dac0-4088-9826-65b26c6dd473 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:21.852014 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-835558ed-dac0-4088-9826-65b26c6dd473 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:21.857905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-835558ed-dac0-4088-9826-65b26c6dd473 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:21.858393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-835558ed-dac0-4088-9826-65b26c6dd473 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:21.858831 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-835558ed-dac0-4088-9826-65b26c6dd473 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:21.859535 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-835558ed-dac0-4088-9826-65b26c6dd473 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:21.859986 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-835558ed-dac0-4088-9826-65b26c6dd473 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:21.860416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-835558ed-dac0-4088-9826-65b26c6dd473 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:21.913437 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1f1608e4-aa11-4f27-9807-cf2141a0adbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:21.921935 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1f1608e4-aa11-4f27-9807-cf2141a0adbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.197171 Aug 18 11:04:21.922723 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 135/261] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:21 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:22.100288 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-835558ed-dac0-4088-9826-65b26c6dd473 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:22.108819 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-835558ed-dac0-4088-9826-65b26c6dd473 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1503 microversion: 2.1 time: 0.263645 Aug 18 11:04:22.109743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 127/262] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:21 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:22.291448 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-9d6e5b85-80cf-4b59-833b-ac65b77d059e req-5067c5fa-53a3-4a9b-a749-98ef0fdf97b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a38c9ed-092c-4a82-9581-85326a84f582", "name": "network-vif-deleted", "tag": "4bed2960-285e-436c-92c4-807908aec234"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:22.302164 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-9d6e5b85-80cf-4b59-833b-ac65b77d059e req-5067c5fa-53a3-4a9b-a749-98ef0fdf97b6 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:22.302648 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-9d6e5b85-80cf-4b59-833b-ac65b77d059e req-5067c5fa-53a3-4a9b-a749-98ef0fdf97b6 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:22.303083 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-9d6e5b85-80cf-4b59-833b-ac65b77d059e req-5067c5fa-53a3-4a9b-a749-98ef0fdf97b6 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:22.318966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-9d6e5b85-80cf-4b59-833b-ac65b77d059e req-5067c5fa-53a3-4a9b-a749-98ef0fdf97b6 service nova] Creating event network-vif-deleted:4bed2960-285e-436c-92c4-807908aec234 for instance 9a38c9ed-092c-4a82-9581-85326a84f582 on hv-cinder-82660 Aug 18 11:04:22.326273 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-9d6e5b85-80cf-4b59-833b-ac65b77d059e req-5067c5fa-53a3-4a9b-a749-98ef0fdf97b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038815 Aug 18 11:04:22.326895 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 136/263] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:04:22.551653 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0706687b-02a1-4459-8182-4b0aa83eba6e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:22.552267 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0706687b-02a1-4459-8182-4b0aa83eba6e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:22.558603 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0706687b-02a1-4459-8182-4b0aa83eba6e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:22.559122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0706687b-02a1-4459-8182-4b0aa83eba6e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:22.559577 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0706687b-02a1-4459-8182-4b0aa83eba6e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:22.560281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0706687b-02a1-4459-8182-4b0aa83eba6e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:22.560738 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0706687b-02a1-4459-8182-4b0aa83eba6e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:22.561368 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0706687b-02a1-4459-8182-4b0aa83eba6e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:22.631822 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0706687b-02a1-4459-8182-4b0aa83eba6e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:22.640420 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0706687b-02a1-4459-8182-4b0aa83eba6e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1512 microversion: 2.1 time: 0.092658 Aug 18 11:04:22.641011 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 128/264] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:22 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:22.946135 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5f883275-d5f6-4be5-9bf0-e853026c769d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:22.947026 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5f883275-d5f6-4be5-9bf0-e853026c769d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:22.954134 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f883275-d5f6-4be5-9bf0-e853026c769d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:22.954621 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f883275-d5f6-4be5-9bf0-e853026c769d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:22.955062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f883275-d5f6-4be5-9bf0-e853026c769d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:22.955756 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f883275-d5f6-4be5-9bf0-e853026c769d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:22.956218 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f883275-d5f6-4be5-9bf0-e853026c769d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:22.956725 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f883275-d5f6-4be5-9bf0-e853026c769d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:23.100444 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5f883275-d5f6-4be5-9bf0-e853026c769d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:23.109918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5f883275-d5f6-4be5-9bf0-e853026c769d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.169108 Aug 18 11:04:23.110512 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 137/265] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:22 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:23.131452 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-36bd356b-c811-4bae-9870-5d7abe2114b7 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:23.132337 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-36bd356b-c811-4bae-9870-5d7abe2114b7 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:23.139223 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36bd356b-c811-4bae-9870-5d7abe2114b7 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:23.139707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36bd356b-c811-4bae-9870-5d7abe2114b7 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:23.140143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36bd356b-c811-4bae-9870-5d7abe2114b7 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:23.140897 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36bd356b-c811-4bae-9870-5d7abe2114b7 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:23.141388 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36bd356b-c811-4bae-9870-5d7abe2114b7 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:23.141932 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-36bd356b-c811-4bae-9870-5d7abe2114b7 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:23.277086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-36bd356b-c811-4bae-9870-5d7abe2114b7 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:23.285168 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-36bd356b-c811-4bae-9870-5d7abe2114b7 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1503 microversion: 2.1 time: 0.158032 Aug 18 11:04:23.286055 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 129/266] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:23 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:23.665260 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2ccd8c23-e10d-49f6-9c17-60248fef901e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:23.666283 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2ccd8c23-e10d-49f6-9c17-60248fef901e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:23.672848 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd8c23-e10d-49f6-9c17-60248fef901e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:23.673674 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd8c23-e10d-49f6-9c17-60248fef901e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:23.674343 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd8c23-e10d-49f6-9c17-60248fef901e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:23.675447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd8c23-e10d-49f6-9c17-60248fef901e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:23.676798 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd8c23-e10d-49f6-9c17-60248fef901e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:23.677728 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2ccd8c23-e10d-49f6-9c17-60248fef901e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:23.766062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2ccd8c23-e10d-49f6-9c17-60248fef901e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b548df8cdf40d4879efbd34563385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532114507c3e4c8e8d14dd3cfdd65c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:23.778345 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2ccd8c23-e10d-49f6-9c17-60248fef901e tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 200 len: 1346 microversion: 2.1 time: 0.119102 Aug 18 11:04:23.794181 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 138/267] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:23 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 1346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:24.133649 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ff646171-9014-4c17-8e95-1c98b52f0807 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:24.134994 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ff646171-9014-4c17-8e95-1c98b52f0807 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:24.143485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ff646171-9014-4c17-8e95-1c98b52f0807 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:24.144001 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ff646171-9014-4c17-8e95-1c98b52f0807 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:24.145080 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ff646171-9014-4c17-8e95-1c98b52f0807 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:24.146104 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ff646171-9014-4c17-8e95-1c98b52f0807 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:24.146776 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ff646171-9014-4c17-8e95-1c98b52f0807 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:24.148550 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ff646171-9014-4c17-8e95-1c98b52f0807 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:24.307338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c94efbd7-f9db-4a4c-9262-6234d976f1ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:24.307954 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c94efbd7-f9db-4a4c-9262-6234d976f1ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:24.313987 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c94efbd7-f9db-4a4c-9262-6234d976f1ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:24.314475 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c94efbd7-f9db-4a4c-9262-6234d976f1ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:24.314905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c94efbd7-f9db-4a4c-9262-6234d976f1ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:24.315732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c94efbd7-f9db-4a4c-9262-6234d976f1ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:24.316782 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c94efbd7-f9db-4a4c-9262-6234d976f1ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:24.317206 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c94efbd7-f9db-4a4c-9262-6234d976f1ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:24.394600 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ff646171-9014-4c17-8e95-1c98b52f0807 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:24.404620 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ff646171-9014-4c17-8e95-1c98b52f0807 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.276343 Aug 18 11:04:24.405200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 130/268] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:24 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:24.478477 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c94efbd7-f9db-4a4c-9262-6234d976f1ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:24.480795 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=100 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:24.487381 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c94efbd7-f9db-4a4c-9262-6234d976f1ee tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 200 len: 1503 microversion: 2.1 time: 0.183887 Aug 18 11:04:24.488692 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 139/269] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:24 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:24.673990 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-f60e1a14-7227-4358-8a6e-2c6e6d4871cf req-05511b4c-4e6e-49f5-9384-46504b0cb154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a19e95d-516b-457e-8b0f-00794fb8a6e0", "name": "network-vif-deleted", "tag": "a03dceb4-130c-42d9-b3e6-7ab74008e2be"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:24.688607 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-f60e1a14-7227-4358-8a6e-2c6e6d4871cf req-05511b4c-4e6e-49f5-9384-46504b0cb154 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:24.689081 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-f60e1a14-7227-4358-8a6e-2c6e6d4871cf req-05511b4c-4e6e-49f5-9384-46504b0cb154 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:24.689503 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-f60e1a14-7227-4358-8a6e-2c6e6d4871cf req-05511b4c-4e6e-49f5-9384-46504b0cb154 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:24.700865 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-f60e1a14-7227-4358-8a6e-2c6e6d4871cf req-05511b4c-4e6e-49f5-9384-46504b0cb154 service nova] Creating event network-vif-deleted:a03dceb4-130c-42d9-b3e6-7ab74008e2be for instance 3a19e95d-516b-457e-8b0f-00794fb8a6e0 on hv-cinder-82660 Aug 18 11:04:24.705618 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-f60e1a14-7227-4358-8a6e-2c6e6d4871cf req-05511b4c-4e6e-49f5-9384-46504b0cb154 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038711 Aug 18 11:04:24.706198 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 131/270] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:04:24.802906 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:24.803502 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:24.810167 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:24.810653 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:24.811140 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:24.811767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:24.812210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:24.812626 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:24.827420 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] HTTP exception thrown: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Request method failure captured: Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 HTTP/1.1 Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxcWPDovWFgfutisnTXbZKgqdcJw-XjDBueWhF31I2t8WN7JiAXyTIT96xfXG8Gxk-6MZC8D-Mj368B8VHCqUDtnzj8sOe9Q3hgrbwKE0RZN5apyIMNnWJxp-inWdWlMW5PAh70c8sVZTiyQBQjwVJlen-BdlhDMLUSWL1sDcvyRF4 Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 532114507c3e4c8e8d14dd3cfdd65c6a Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:04:24.832718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_532114507c3e4c8e8d14dd3cfdd65c6a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/532114507c3e4c8e8d14dd3cfdd65c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/532114507c3e4c8e8d14dd3cfdd65c6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/532114507c3e4c8e8d14dd3cfdd65c6a"}]}] Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 532114507c3e4c8e8d14dd3cfdd65c6a Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-DeleteServersTestJSON-871241134-project Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 10b548df8cdf40d4879efbd34563385e Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-DeleteServersTestJSON-871241134-project Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:24.834211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '9a38c9ed-092c-4a82-9581-85326a84f582'} Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:04:24.835047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:24.836175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:24.837281 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Returning 404 to user: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:04:24.837281 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-be1b9627-ad45-4cf0-9192-42dc2d3593c0 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 404 len: 111 microversion: 2.1 time: 0.036029 Aug 18 11:04:24.839042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 140/271] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:24 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:04:24.960848 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:24.963452 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:24.973539 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:24.974038 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:24.974472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:24.975174 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:24.975627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:24.976053 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:24.990079 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] HTTP exception thrown: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Request method failure captured: Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582/os-volume_attachments HTTP/1.1 Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxcWPDovWFgfutisnTXbZKgqdcJw-XjDBueWhF31I2t8WN7JiAXyTIT96xfXG8Gxk-6MZC8D-Mj368B8VHCqUDtnzj8sOe9Q3hgrbwKE0RZN5apyIMNnWJxp-inWdWlMW5PAh70c8sVZTiyQBQjwVJlen-BdlhDMLUSWL1sDcvyRF4 Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 532114507c3e4c8e8d14dd3cfdd65c6a Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:04:24.994385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_532114507c3e4c8e8d14dd3cfdd65c6a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/532114507c3e4c8e8d14dd3cfdd65c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/532114507c3e4c8e8d14dd3cfdd65c6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/532114507c3e4c8e8d14dd3cfdd65c6a"}]}] Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 532114507c3e4c8e8d14dd3cfdd65c6a Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-DeleteServersTestJSON-871241134-project Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 10b548df8cdf40d4879efbd34563385e Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-DeleteServersTestJSON-871241134-project Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:24.995859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'server_id': '9a38c9ed-092c-4a82-9581-85326a84f582'} Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:04:24.996680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:24.997977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:24.999048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Returning 404 to user: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:04:24.999048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ed8a4d6c-5af4-43ee-ba19-e6918d1f3a43 tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040351 Aug 18 11:04:24.999048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 132/272] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:04:24 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:04:25.428234 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8eda819d-2515-4e7f-a9b5-64d226613442 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:25.428935 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8eda819d-2515-4e7f-a9b5-64d226613442 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:25.435790 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8eda819d-2515-4e7f-a9b5-64d226613442 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:25.436938 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8eda819d-2515-4e7f-a9b5-64d226613442 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:25.437385 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8eda819d-2515-4e7f-a9b5-64d226613442 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:25.438136 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8eda819d-2515-4e7f-a9b5-64d226613442 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:25.438599 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8eda819d-2515-4e7f-a9b5-64d226613442 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:25.439041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8eda819d-2515-4e7f-a9b5-64d226613442 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:25.508893 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:25.509563 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: 3a19e95d-516b-457e-8b0f-00794fb8a6e0] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:25.516590 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:25.517316 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:25.517834 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:25.518600 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:25.519306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:25.519883 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:25.535656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] HTTP exception thrown: Instance 3a19e95d-516b-457e-8b0f-00794fb8a6e0 could not be found. Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Request method failure captured: Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 HTTP/1.1 Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hyIzSDcFqHIKQHJhLJHo5zk_iwJeXXX-v1oUdqAXAUF_7mWgIdFaTRAtzADA2I6b-xsqTJWFhE6lwTUUPYU2TWTsJuwXzaRJOXAmeqgSyQeF407BLF6nyRkZk1AfMc3GvCrYJRqZV62v68ZMKS0a3pCrMGofogGqILDGAZHw-RQJG8 Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: d591dc6849c641888dbd28827a629d31 Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-VolumesActionsTest-915252765 Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:04:25.538319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d591dc6849c641888dbd28827a629d31", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d591dc6849c641888dbd28827a629d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d591dc6849c641888dbd28827a629d31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d591dc6849c641888dbd28827a629d31"}]}] Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-VolumesActionsTest-915252765 Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: d591dc6849c641888dbd28827a629d31 Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-VolumesActionsTest-915252765 Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-VolumesActionsTest-915252765-project Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 2ea5b4501d934e1bbfd6d46577d09e5d Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-VolumesActionsTest-915252765-project Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 3a19e95d-516b-457e-8b0f-00794fb8a6e0 could not be found. Aug 18 11:04:25.539873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '3a19e95d-516b-457e-8b0f-00794fb8a6e0'} Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a19e95d-516b-457e-8b0f-00794fb8a6e0 could not be found. Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:04:25.540642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a19e95d-516b-457e-8b0f-00794fb8a6e0 could not be found. Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a19e95d-516b-457e-8b0f-00794fb8a6e0 could not be found. Aug 18 11:04:25.541802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:25.546626 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Returning 404 to user: Instance 3a19e95d-516b-457e-8b0f-00794fb8a6e0 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:04:25.546626 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4cf38303-11f3-40e7-a59d-2f009abe8c59 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0" status: 404 len: 111 microversion: 2.1 time: 0.036072 Aug 18 11:04:25.546626 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 133/273] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:25 2022] GET /compute/v2.1/servers/3a19e95d-516b-457e-8b0f-00794fb8a6e0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:04:25.658907 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-208996361", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "networks": [{"uuid": "930e3c79-4766-4aeb-a65f-466e9f963721"}]}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:25.718432 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] validate_networks() for [('930e3c79-4766-4aeb-a65f-466e9f963721', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:04:25.904902 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8eda819d-2515-4e7f-a9b5-64d226613442 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:25.914408 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8eda819d-2515-4e7f-a9b5-64d226613442 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.491577 Aug 18 11:04:25.915337 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 141/274] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:25 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:26.119888 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:04:26.120394 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:04:26.120918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:04:26.121548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:04:26.121978 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:04:26.131701 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:26.132181 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:26.132614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:26.133327 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:26.133800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:26.134224 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:26.151833 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Getting quotas for project d591dc6849c641888dbd28827a629d31. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:04:26.156118 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Getting quotas for user 2ea5b4501d934e1bbfd6d46577d09e5d and project d591dc6849c641888dbd28827a629d31. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:04:26.169368 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:04:26.171620 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:04:26.226211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e8702448-8a0f-4210-9a2f-12ebc7db94e6 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571192 Aug 18 11:04:26.227026 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 134/275] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:04:26.237776 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5fedbf53-b3a9-4ba0-b27c-e2ab93369e73 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:26.239012 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5fedbf53-b3a9-4ba0-b27c-e2ab93369e73 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:26.302605 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5fedbf53-b3a9-4ba0-b27c-e2ab93369e73 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:26.309896 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5fedbf53-b3a9-4ba0-b27c-e2ab93369e73 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1213 microversion: 2.1 time: 0.075837 Aug 18 11:04:26.313570 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 142/276] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:26 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:26.358959 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:26.359677 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:26.367166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:26.367924 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:26.368512 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:26.369538 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:26.370542 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:26.371587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:26.392166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] HTTP exception thrown: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Request method failure captured: Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: DELETE /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 HTTP/1.1 Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxcWPDovWFgfutisnTXbZKgqdcJw-XjDBueWhF31I2t8WN7JiAXyTIT96xfXG8Gxk-6MZC8D-Mj368B8VHCqUDtnzj8sOe9Q3hgrbwKE0RZN5apyIMNnWJxp-inWdWlMW5PAh70c8sVZTiyQBQjwVJlen-BdlhDMLUSWL1sDcvyRF4 Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 532114507c3e4c8e8d14dd3cfdd65c6a Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:04:26.393837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_532114507c3e4c8e8d14dd3cfdd65c6a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/532114507c3e4c8e8d14dd3cfdd65c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/532114507c3e4c8e8d14dd3cfdd65c6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/532114507c3e4c8e8d14dd3cfdd65c6a"}]}] Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 532114507c3e4c8e8d14dd3cfdd65c6a Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-DeleteServersTestJSON-871241134-project Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 10b548df8cdf40d4879efbd34563385e Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-DeleteServersTestJSON-871241134-project Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:26.396445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '9a38c9ed-092c-4a82-9581-85326a84f582'} Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:04:26.397736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:26.399143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:26.400458 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Returning 404 to user: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:04:26.400458 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-db594d52-aa5b-459a-b09c-5db312d9478f tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 404 len: 111 microversion: 2.1 time: 0.041827 Aug 18 11:04:26.400458 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 135/277] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:04:26 2022] DELETE /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:04:26.407607 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:26.408732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] [instance: 9a38c9ed-092c-4a82-9581-85326a84f582] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:26.416083 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:26.416760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:26.417349 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:26.419235 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:26.419791 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:26.420559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:26.626729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] HTTP exception thrown: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Request method failure captured: Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 HTTP/1.1 Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxcWPDovWFgfutisnTXbZKgqdcJw-XjDBueWhF31I2t8WN7JiAXyTIT96xfXG8Gxk-6MZC8D-Mj368B8VHCqUDtnzj8sOe9Q3hgrbwKE0RZN5apyIMNnWJxp-inWdWlMW5PAh70c8sVZTiyQBQjwVJlen-BdlhDMLUSWL1sDcvyRF4 Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 532114507c3e4c8e8d14dd3cfdd65c6a Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:04:26.629097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_532114507c3e4c8e8d14dd3cfdd65c6a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/532114507c3e4c8e8d14dd3cfdd65c6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/532114507c3e4c8e8d14dd3cfdd65c6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/532114507c3e4c8e8d14dd3cfdd65c6a"}]}] Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 532114507c3e4c8e8d14dd3cfdd65c6a Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-DeleteServersTestJSON-871241134 Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-DeleteServersTestJSON-871241134-project Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 10b548df8cdf40d4879efbd34563385e Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-DeleteServersTestJSON-871241134-project Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:26.630551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '9a38c9ed-092c-4a82-9581-85326a84f582'} Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:04:26.631209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. Aug 18 11:04:26.632221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:26.634654 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] Returning 404 to user: Instance 9a38c9ed-092c-4a82-9581-85326a84f582 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:04:26.636276 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b281f40c-c86d-4985-bad0-4c4069c075ca tempest-DeleteServersTestJSON-871241134 tempest-DeleteServersTestJSON-871241134-project] 10.222.0.15 "GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582" status: 404 len: 111 microversion: 2.1 time: 0.234163 Aug 18 11:04:26.641648 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 143/278] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:26 2022] GET /compute/v2.1/servers/9a38c9ed-092c-4a82-9581-85326a84f582 => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:04:26.937876 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6cf482f1-8e2d-4380-b7de-f36ad2774706 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:26.939172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6cf482f1-8e2d-4380-b7de-f36ad2774706 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:26.961476 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6cf482f1-8e2d-4380-b7de-f36ad2774706 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:26.962744 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6cf482f1-8e2d-4380-b7de-f36ad2774706 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:26.963193 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6cf482f1-8e2d-4380-b7de-f36ad2774706 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:26.963905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6cf482f1-8e2d-4380-b7de-f36ad2774706 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:26.966369 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6cf482f1-8e2d-4380-b7de-f36ad2774706 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:26.968615 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6cf482f1-8e2d-4380-b7de-f36ad2774706 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:27.337432 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fafcec16-3d2f-44bf-b029-6c0f698e5c94 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:27.338418 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fafcec16-3d2f-44bf-b029-6c0f698e5c94 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:27.339020 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6cf482f1-8e2d-4380-b7de-f36ad2774706 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:27.345932 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fafcec16-3d2f-44bf-b029-6c0f698e5c94 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:27.346347 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fafcec16-3d2f-44bf-b029-6c0f698e5c94 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:27.346965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fafcec16-3d2f-44bf-b029-6c0f698e5c94 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:27.348563 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fafcec16-3d2f-44bf-b029-6c0f698e5c94 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:27.349209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fafcec16-3d2f-44bf-b029-6c0f698e5c94 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:27.349777 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fafcec16-3d2f-44bf-b029-6c0f698e5c94 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:27.351819 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6cf482f1-8e2d-4380-b7de-f36ad2774706 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.419043 Aug 18 11:04:27.353172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 136/279] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:26 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:27.451627 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-fafcec16-3d2f-44bf-b029-6c0f698e5c94 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:27.471399 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fafcec16-3d2f-44bf-b029-6c0f698e5c94 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1265 microversion: 2.1 time: 0.138186 Aug 18 11:04:27.474179 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 144/280] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:27 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:28.376446 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f50b9270-5aa1-47a2-92ba-30aa28354949 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:28.381121 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f50b9270-5aa1-47a2-92ba-30aa28354949 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:28.393936 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f50b9270-5aa1-47a2-92ba-30aa28354949 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:28.395104 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f50b9270-5aa1-47a2-92ba-30aa28354949 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:28.396315 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f50b9270-5aa1-47a2-92ba-30aa28354949 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:28.398137 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f50b9270-5aa1-47a2-92ba-30aa28354949 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:28.398884 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f50b9270-5aa1-47a2-92ba-30aa28354949 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:28.399519 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f50b9270-5aa1-47a2-92ba-30aa28354949 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:28.497761 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9d46534f-2aeb-4966-b5cd-622b94d1a76a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:28.498385 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9d46534f-2aeb-4966-b5cd-622b94d1a76a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:28.506914 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d46534f-2aeb-4966-b5cd-622b94d1a76a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:28.507412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d46534f-2aeb-4966-b5cd-622b94d1a76a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:28.507853 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d46534f-2aeb-4966-b5cd-622b94d1a76a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:28.508570 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d46534f-2aeb-4966-b5cd-622b94d1a76a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:28.509064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d46534f-2aeb-4966-b5cd-622b94d1a76a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:28.509588 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d46534f-2aeb-4966-b5cd-622b94d1a76a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:28.639211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9d46534f-2aeb-4966-b5cd-622b94d1a76a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:28.654684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9d46534f-2aeb-4966-b5cd-622b94d1a76a tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1271 microversion: 2.1 time: 0.160605 Aug 18 11:04:28.657102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 145/281] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:28 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:29.006824 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f50b9270-5aa1-47a2-92ba-30aa28354949 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:29.016913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f50b9270-5aa1-47a2-92ba-30aa28354949 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.646655 Aug 18 11:04:29.017019 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 137/282] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:28 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:29.688892 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c8c20424-e223-4462-ad3f-4afad861ef0d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:29.689557 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c8c20424-e223-4462-ad3f-4afad861ef0d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:29.700401 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8c20424-e223-4462-ad3f-4afad861ef0d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:29.703773 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8c20424-e223-4462-ad3f-4afad861ef0d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:29.704238 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8c20424-e223-4462-ad3f-4afad861ef0d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:29.717592 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8c20424-e223-4462-ad3f-4afad861ef0d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:29.718217 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8c20424-e223-4462-ad3f-4afad861ef0d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:29.718675 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8c20424-e223-4462-ad3f-4afad861ef0d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:30.021102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c8c20424-e223-4462-ad3f-4afad861ef0d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:30.040224 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-74d64aa5-cf1d-434b-8e58-074758d4fce7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:30.041810 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-74d64aa5-cf1d-434b-8e58-074758d4fce7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:30.051031 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-74d64aa5-cf1d-434b-8e58-074758d4fce7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:30.051533 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c8c20424-e223-4462-ad3f-4afad861ef0d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1313 microversion: 2.1 time: 0.368347 Aug 18 11:04:30.052364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 146/283] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:29 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:30.053082 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-74d64aa5-cf1d-434b-8e58-074758d4fce7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:30.054120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-74d64aa5-cf1d-434b-8e58-074758d4fce7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:30.055062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-74d64aa5-cf1d-434b-8e58-074758d4fce7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:30.055858 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-74d64aa5-cf1d-434b-8e58-074758d4fce7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:30.056476 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-74d64aa5-cf1d-434b-8e58-074758d4fce7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:30.504111 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-74d64aa5-cf1d-434b-8e58-074758d4fce7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:30.507403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:30.519684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-74d64aa5-cf1d-434b-8e58-074758d4fce7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.484526 Aug 18 11:04:30.520266 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 138/284] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:30 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:30.792242 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-ef12cc22-c579-4637-9fa1-731c234beb1e req-aec4311c-4b8c-49be-96c3-c648d138802c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f19e050b-36af-4e08-80e0-9e295807be45", "tag": "17052100-3aed-4863-bdf1-88e17e1aed07"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:30.828823 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-ef12cc22-c579-4637-9fa1-731c234beb1e req-aec4311c-4b8c-49be-96c3-c648d138802c service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:30.831328 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-ef12cc22-c579-4637-9fa1-731c234beb1e req-aec4311c-4b8c-49be-96c3-c648d138802c service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:30.832495 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-ef12cc22-c579-4637-9fa1-731c234beb1e req-aec4311c-4b8c-49be-96c3-c648d138802c service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:30.860271 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-ef12cc22-c579-4637-9fa1-731c234beb1e req-aec4311c-4b8c-49be-96c3-c648d138802c service nova] Creating event network-changed:17052100-3aed-4863-bdf1-88e17e1aed07 for instance f19e050b-36af-4e08-80e0-9e295807be45 on hv-cinder-82660 Aug 18 11:04:30.870266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-ef12cc22-c579-4637-9fa1-731c234beb1e req-aec4311c-4b8c-49be-96c3-c648d138802c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082957 Aug 18 11:04:30.873964 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 147/285] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:04:31.073024 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fbbb6cbf-e5b6-40bc-9908-6eefec4fb98c tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:31.073732 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fbbb6cbf-e5b6-40bc-9908-6eefec4fb98c tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:31.087486 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbbb6cbf-e5b6-40bc-9908-6eefec4fb98c tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:31.087999 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbbb6cbf-e5b6-40bc-9908-6eefec4fb98c tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:31.088420 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbbb6cbf-e5b6-40bc-9908-6eefec4fb98c tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:31.098441 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbbb6cbf-e5b6-40bc-9908-6eefec4fb98c tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:31.099082 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbbb6cbf-e5b6-40bc-9908-6eefec4fb98c tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:31.099537 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbbb6cbf-e5b6-40bc-9908-6eefec4fb98c tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:31.552639 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8392f593-df06-4f9d-b446-39d89ce55bd2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:31.553969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8392f593-df06-4f9d-b446-39d89ce55bd2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:31.570571 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8392f593-df06-4f9d-b446-39d89ce55bd2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:31.571504 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8392f593-df06-4f9d-b446-39d89ce55bd2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:31.574707 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8392f593-df06-4f9d-b446-39d89ce55bd2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:31.575757 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8392f593-df06-4f9d-b446-39d89ce55bd2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:31.578157 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8392f593-df06-4f9d-b446-39d89ce55bd2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:31.578973 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8392f593-df06-4f9d-b446-39d89ce55bd2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:31.902563 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8392f593-df06-4f9d-b446-39d89ce55bd2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:31.922119 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8392f593-df06-4f9d-b446-39d89ce55bd2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.371268 Aug 18 11:04:31.922948 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 148/286] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:31 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:31.970712 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fbbb6cbf-e5b6-40bc-9908-6eefec4fb98c tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:31.981809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fbbb6cbf-e5b6-40bc-9908-6eefec4fb98c tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1313 microversion: 2.1 time: 0.912533 Aug 18 11:04:31.995777 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 139/287] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:31 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1313 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:32.948073 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-baf31770-71e1-44c8-bb9f-1b9d007d0a91 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:32.948968 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-baf31770-71e1-44c8-bb9f-1b9d007d0a91 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:32.959609 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-baf31770-71e1-44c8-bb9f-1b9d007d0a91 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:32.965287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-baf31770-71e1-44c8-bb9f-1b9d007d0a91 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:32.965775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-baf31770-71e1-44c8-bb9f-1b9d007d0a91 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:32.966522 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-baf31770-71e1-44c8-bb9f-1b9d007d0a91 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:32.966991 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-baf31770-71e1-44c8-bb9f-1b9d007d0a91 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:32.970344 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-baf31770-71e1-44c8-bb9f-1b9d007d0a91 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:33.007868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4e0f9693-3b0e-4d9a-859f-037242cdb072 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:33.009221 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4e0f9693-3b0e-4d9a-859f-037242cdb072 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:33.026871 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4e0f9693-3b0e-4d9a-859f-037242cdb072 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:33.039401 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4e0f9693-3b0e-4d9a-859f-037242cdb072 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:33.041703 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4e0f9693-3b0e-4d9a-859f-037242cdb072 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:33.042670 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4e0f9693-3b0e-4d9a-859f-037242cdb072 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:33.045864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4e0f9693-3b0e-4d9a-859f-037242cdb072 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:33.046534 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4e0f9693-3b0e-4d9a-859f-037242cdb072 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:33.393675 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4e0f9693-3b0e-4d9a-859f-037242cdb072 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:33.414224 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4e0f9693-3b0e-4d9a-859f-037242cdb072 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1313 microversion: 2.1 time: 0.414048 Aug 18 11:04:33.415747 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 140/288] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:32 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:33.550613 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-baf31770-71e1-44c8-bb9f-1b9d007d0a91 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:33.561274 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-baf31770-71e1-44c8-bb9f-1b9d007d0a91 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.620529 Aug 18 11:04:33.577759 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 149/289] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:32 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:34.438888 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-bc6f8a64-b16d-40eb-99c4-58b868e222df tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:34.440175 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-bc6f8a64-b16d-40eb-99c4-58b868e222df tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:34.453987 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bc6f8a64-b16d-40eb-99c4-58b868e222df tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:34.454740 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bc6f8a64-b16d-40eb-99c4-58b868e222df tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:34.457651 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bc6f8a64-b16d-40eb-99c4-58b868e222df tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:34.458633 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bc6f8a64-b16d-40eb-99c4-58b868e222df tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:34.462167 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bc6f8a64-b16d-40eb-99c4-58b868e222df tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:34.463032 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bc6f8a64-b16d-40eb-99c4-58b868e222df tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:34.586127 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-87e982f0-ff38-47d6-befd-0648fbbec1dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:34.587775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-87e982f0-ff38-47d6-befd-0648fbbec1dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:34.602503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-87e982f0-ff38-47d6-befd-0648fbbec1dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:34.603903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-87e982f0-ff38-47d6-befd-0648fbbec1dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:34.610523 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-87e982f0-ff38-47d6-befd-0648fbbec1dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:34.612495 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-87e982f0-ff38-47d6-befd-0648fbbec1dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:34.616434 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-87e982f0-ff38-47d6-befd-0648fbbec1dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:34.618573 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-87e982f0-ff38-47d6-befd-0648fbbec1dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:34.861334 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bc6f8a64-b16d-40eb-99c4-58b868e222df tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:34.872127 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-bc6f8a64-b16d-40eb-99c4-58b868e222df tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1313 microversion: 2.1 time: 0.438469 Aug 18 11:04:34.872848 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 141/290] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:34 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:35.111596 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-87e982f0-ff38-47d6-befd-0648fbbec1dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:35.126086 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-87e982f0-ff38-47d6-befd-0648fbbec1dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.544780 Aug 18 11:04:35.127601 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 150/291] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:34 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:35.901182 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-aa4512fd-dc08-444e-bd7d-1b410a2107ca tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:35.902862 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-aa4512fd-dc08-444e-bd7d-1b410a2107ca tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:35.916155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aa4512fd-dc08-444e-bd7d-1b410a2107ca tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:35.916960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aa4512fd-dc08-444e-bd7d-1b410a2107ca tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:35.917614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aa4512fd-dc08-444e-bd7d-1b410a2107ca tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:35.919164 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aa4512fd-dc08-444e-bd7d-1b410a2107ca tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:35.919918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aa4512fd-dc08-444e-bd7d-1b410a2107ca tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:35.920818 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aa4512fd-dc08-444e-bd7d-1b410a2107ca tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:36.143845 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:36.149489 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6eb22046-6a34-436c-8f38-1e84c46a0066 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:36.151077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6eb22046-6a34-436c-8f38-1e84c46a0066 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:36.157862 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6eb22046-6a34-436c-8f38-1e84c46a0066 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:36.158352 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6eb22046-6a34-436c-8f38-1e84c46a0066 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:36.163431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6eb22046-6a34-436c-8f38-1e84c46a0066 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:36.164145 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6eb22046-6a34-436c-8f38-1e84c46a0066 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:36.164627 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6eb22046-6a34-436c-8f38-1e84c46a0066 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:36.165455 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=6 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:36.167577 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6eb22046-6a34-436c-8f38-1e84c46a0066 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:36.273062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-aa4512fd-dc08-444e-bd7d-1b410a2107ca tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:36.288504 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-aa4512fd-dc08-444e-bd7d-1b410a2107ca tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1313 microversion: 2.1 time: 0.393534 Aug 18 11:04:36.289095 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 142/292] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:35 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:36.307449 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:36.548556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6eb22046-6a34-436c-8f38-1e84c46a0066 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:36.572420 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6eb22046-6a34-436c-8f38-1e84c46a0066 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.424686 Aug 18 11:04:36.573380 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 151/293] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:36 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:37.322433 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8d556ba7-28d6-49b5-941d-ff058f271cd3 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:37.323049 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8d556ba7-28d6-49b5-941d-ff058f271cd3 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:37.331001 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8d556ba7-28d6-49b5-941d-ff058f271cd3 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:37.331544 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8d556ba7-28d6-49b5-941d-ff058f271cd3 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:37.333365 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8d556ba7-28d6-49b5-941d-ff058f271cd3 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:37.334723 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8d556ba7-28d6-49b5-941d-ff058f271cd3 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:37.335413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8d556ba7-28d6-49b5-941d-ff058f271cd3 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:37.335852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8d556ba7-28d6-49b5-941d-ff058f271cd3 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:37.594321 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1c445fe3-d123-49ed-a492-ebfa370746d6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:37.594934 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1c445fe3-d123-49ed-a492-ebfa370746d6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:37.602804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c445fe3-d123-49ed-a492-ebfa370746d6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:37.611163 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c445fe3-d123-49ed-a492-ebfa370746d6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:37.613393 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c445fe3-d123-49ed-a492-ebfa370746d6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:37.621859 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c445fe3-d123-49ed-a492-ebfa370746d6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:37.625680 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c445fe3-d123-49ed-a492-ebfa370746d6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:37.626361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c445fe3-d123-49ed-a492-ebfa370746d6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:37.705010 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8d556ba7-28d6-49b5-941d-ff058f271cd3 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:37.723956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8d556ba7-28d6-49b5-941d-ff058f271cd3 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1313 microversion: 2.1 time: 0.414367 Aug 18 11:04:37.738277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 143/294] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:37 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:37.975485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-e6292967-1f48-41b0-9120-76f6f5948f9e req-4606fc31-8f2e-422b-a6a5-5823954d40e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19e050b-36af-4e08-80e0-9e295807be45", "name": "network-vif-plugged", "status": "completed", "tag": "17052100-3aed-4863-bdf1-88e17e1aed07"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:37.992985 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e6292967-1f48-41b0-9120-76f6f5948f9e req-4606fc31-8f2e-422b-a6a5-5823954d40e6 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:37.993483 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e6292967-1f48-41b0-9120-76f6f5948f9e req-4606fc31-8f2e-422b-a6a5-5823954d40e6 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:37.995792 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e6292967-1f48-41b0-9120-76f6f5948f9e req-4606fc31-8f2e-422b-a6a5-5823954d40e6 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:38.020135 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1c445fe3-d123-49ed-a492-ebfa370746d6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:38.028057 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1c445fe3-d123-49ed-a492-ebfa370746d6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.438084 Aug 18 11:04:38.031020 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 152/295] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:37 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:38.043716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-e6292967-1f48-41b0-9120-76f6f5948f9e req-4606fc31-8f2e-422b-a6a5-5823954d40e6 service nova] Creating event network-vif-plugged:17052100-3aed-4863-bdf1-88e17e1aed07 for instance f19e050b-36af-4e08-80e0-9e295807be45 on hv-cinder-82660 Aug 18 11:04:38.060848 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-e6292967-1f48-41b0-9120-76f6f5948f9e req-4606fc31-8f2e-422b-a6a5-5823954d40e6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089731 Aug 18 11:04:38.061693 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 144/296] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:04:38.756887 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2e7a2427-bf68-4364-9b98-23fbcce0350e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:38.758221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2e7a2427-bf68-4364-9b98-23fbcce0350e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:38.773728 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e7a2427-bf68-4364-9b98-23fbcce0350e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:38.774709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e7a2427-bf68-4364-9b98-23fbcce0350e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:38.775421 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e7a2427-bf68-4364-9b98-23fbcce0350e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:38.790478 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e7a2427-bf68-4364-9b98-23fbcce0350e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:38.791901 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e7a2427-bf68-4364-9b98-23fbcce0350e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:38.793081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e7a2427-bf68-4364-9b98-23fbcce0350e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:39.052453 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-277ce3b8-dac1-4565-a7e0-82df62fe9ce5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:39.053202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-277ce3b8-dac1-4565-a7e0-82df62fe9ce5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:39.065758 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-277ce3b8-dac1-4565-a7e0-82df62fe9ce5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:39.066776 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-277ce3b8-dac1-4565-a7e0-82df62fe9ce5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:39.068239 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-277ce3b8-dac1-4565-a7e0-82df62fe9ce5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:39.069892 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-277ce3b8-dac1-4565-a7e0-82df62fe9ce5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:39.070604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-277ce3b8-dac1-4565-a7e0-82df62fe9ce5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:39.071186 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-277ce3b8-dac1-4565-a7e0-82df62fe9ce5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:39.151165 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2e7a2427-bf68-4364-9b98-23fbcce0350e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:39.164128 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2e7a2427-bf68-4364-9b98-23fbcce0350e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1313 microversion: 2.1 time: 0.412039 Aug 18 11:04:39.174478 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 153/297] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:38 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:39.356826 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-277ce3b8-dac1-4565-a7e0-82df62fe9ce5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:39.377753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-277ce3b8-dac1-4565-a7e0-82df62fe9ce5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1503 microversion: 2.1 time: 0.329531 Aug 18 11:04:39.379308 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 145/298] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:39 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:39.400414 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a55f183e-1f08-4d07-a6de-de6c379a40f7"}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:39.403025 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:39.409487 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:39.410240 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:39.410929 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:39.412239 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:39.414403 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:39.416373 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:39.462603 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] HTTP exception thrown: Cannot 'attach_volume' instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 while it is in vm_state rescued Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Request method failure captured: Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: POST /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762/os-volume_attachments HTTP/1.1 Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 74 Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxam_PDtHLJ-db5zv1qGiOCPbd3HWvSOcxHKrEBJUuzC3C5ATuhSDKsXDjDt3keom5aC4VKFM0yo-U3IE2mEa8cDWLU7B_5Bw9hsBkjmr1uNdMjfzpoIgQRA5wa2VVGVTFWmQFjAgWRd9jH9QKt3AZ88iAfa8bKcQcrFgjEq9EoStU Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: ae09c11177204226a2aa5bb600ee575b Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:04:39.464334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ae09c11177204226a2aa5bb600ee575b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ae09c11177204226a2aa5bb600ee575b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ae09c11177204226a2aa5bb600ee575b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ae09c11177204226a2aa5bb600ee575b"}]}] Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: ae09c11177204226a2aa5bb600ee575b Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-ServerRescueNegativeTestJSON-868309121-project Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 074cfcc7943349a490b29cd4ae3364cb Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-ServerRescueNegativeTestJSON-868309121-project Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {"volumeAttachment": {"volumeId": "a55f183e-1f08-4d07-a6de-de6c379a40f7"}} Aug 18 11:04:39.465623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Cannot 'attach_volume' instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 while it is in vm_state rescued Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'server_id': '8bf6cfd1-8e48-4e4e-9a3b-05363568e762', 'body': {'volumeAttachment': {'volumeId': 'a55f183e-1f08-4d07-a6de-de6c379a40f7'}}} Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:04:39.466313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 while it is in vm_state rescued Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:39.467967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:39.469069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:04:39.469069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:04:39.469069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 while it is in vm_state rescued Aug 18 11:04:39.469069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:04:39.469069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Returning 409 to user: Cannot 'attach_volume' instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 while it is in vm_state rescued {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:04:39.469069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f5e3db37-f4a7-478f-9251-a01cf56a1428 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069370 Aug 18 11:04:39.475687 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ab1c078b-5a69-4131-b062-ef808887a9dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:39.476282 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ab1c078b-5a69-4131-b062-ef808887a9dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:39.479063 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 154/299] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:04:39 2022] POST /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:04:39.483303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab1c078b-5a69-4131-b062-ef808887a9dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:39.484028 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab1c078b-5a69-4131-b062-ef808887a9dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:39.484618 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab1c078b-5a69-4131-b062-ef808887a9dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:39.485486 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab1c078b-5a69-4131-b062-ef808887a9dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:39.486124 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab1c078b-5a69-4131-b062-ef808887a9dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:39.486695 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab1c078b-5a69-4131-b062-ef808887a9dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:39.586956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ab1c078b-5a69-4131-b062-ef808887a9dc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762/action" status: 202 len: 0 microversion: 2.1 time: 0.114869 Aug 18 11:04:39.598658 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b10c5d38-ddc0-4d66-86dc-ba29b7217d22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:39.599423 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b10c5d38-ddc0-4d66-86dc-ba29b7217d22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:39.603000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 146/300] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:04:39 2022] POST /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:04:39.607768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b10c5d38-ddc0-4d66-86dc-ba29b7217d22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:39.608488 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b10c5d38-ddc0-4d66-86dc-ba29b7217d22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:39.609113 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b10c5d38-ddc0-4d66-86dc-ba29b7217d22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:39.610020 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b10c5d38-ddc0-4d66-86dc-ba29b7217d22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:39.611335 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b10c5d38-ddc0-4d66-86dc-ba29b7217d22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:39.611954 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b10c5d38-ddc0-4d66-86dc-ba29b7217d22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:40.014367 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b10c5d38-ddc0-4d66-86dc-ba29b7217d22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:40.026821 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b10c5d38-ddc0-4d66-86dc-ba29b7217d22 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1511 microversion: 2.1 time: 0.433970 Aug 18 11:04:40.044813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 155/301] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:39 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:40.194581 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ba789934-3a48-4f41-8179-c23aea9e5854 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:40.195943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ba789934-3a48-4f41-8179-c23aea9e5854 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:40.211611 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ba789934-3a48-4f41-8179-c23aea9e5854 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:40.212604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ba789934-3a48-4f41-8179-c23aea9e5854 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:40.213044 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ba789934-3a48-4f41-8179-c23aea9e5854 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:40.216475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ba789934-3a48-4f41-8179-c23aea9e5854 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:40.218782 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ba789934-3a48-4f41-8179-c23aea9e5854 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:40.219898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ba789934-3a48-4f41-8179-c23aea9e5854 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:41.008240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ba789934-3a48-4f41-8179-c23aea9e5854 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:41.017768 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ba789934-3a48-4f41-8179-c23aea9e5854 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1313 microversion: 2.1 time: 0.829665 Aug 18 11:04:41.018618 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 147/302] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:40 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1313 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:41.052439 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f1597521-c19e-4c9a-ae36-776b9d3c3b85 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:41.053055 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f1597521-c19e-4c9a-ae36-776b9d3c3b85 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:41.063758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f1597521-c19e-4c9a-ae36-776b9d3c3b85 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:41.066837 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f1597521-c19e-4c9a-ae36-776b9d3c3b85 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:41.067741 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f1597521-c19e-4c9a-ae36-776b9d3c3b85 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:41.070511 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f1597521-c19e-4c9a-ae36-776b9d3c3b85 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:41.070915 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f1597521-c19e-4c9a-ae36-776b9d3c3b85 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:41.071387 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f1597521-c19e-4c9a-ae36-776b9d3c3b85 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:41.413136 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f1597521-c19e-4c9a-ae36-776b9d3c3b85 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:41.426074 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f1597521-c19e-4c9a-ae36-776b9d3c3b85 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1511 microversion: 2.1 time: 0.378661 Aug 18 11:04:41.426867 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 156/303] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:41 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:42.046941 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1ed4e671-707c-43c0-8f1a-48bfc3518d6f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:42.047609 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1ed4e671-707c-43c0-8f1a-48bfc3518d6f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:42.060188 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed4e671-707c-43c0-8f1a-48bfc3518d6f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:42.064206 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed4e671-707c-43c0-8f1a-48bfc3518d6f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:42.066566 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed4e671-707c-43c0-8f1a-48bfc3518d6f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:42.068803 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed4e671-707c-43c0-8f1a-48bfc3518d6f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:42.069294 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed4e671-707c-43c0-8f1a-48bfc3518d6f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:42.069789 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed4e671-707c-43c0-8f1a-48bfc3518d6f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:42.318201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1ed4e671-707c-43c0-8f1a-48bfc3518d6f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:42.327675 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1ed4e671-707c-43c0-8f1a-48bfc3518d6f tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1497 microversion: 2.1 time: 0.286908 Aug 18 11:04:42.328549 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 148/304] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:42 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1497 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:42.459157 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9d08b1b2-feb4-4c82-b94f-a4ee68b3484c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:42.459862 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9d08b1b2-feb4-4c82-b94f-a4ee68b3484c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:42.471400 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d08b1b2-feb4-4c82-b94f-a4ee68b3484c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:42.472829 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d08b1b2-feb4-4c82-b94f-a4ee68b3484c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:42.473344 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d08b1b2-feb4-4c82-b94f-a4ee68b3484c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:42.476800 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d08b1b2-feb4-4c82-b94f-a4ee68b3484c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:42.478654 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d08b1b2-feb4-4c82-b94f-a4ee68b3484c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:42.480595 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d08b1b2-feb4-4c82-b94f-a4ee68b3484c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:42.846106 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9d08b1b2-feb4-4c82-b94f-a4ee68b3484c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:42.859664 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9d08b1b2-feb4-4c82-b94f-a4ee68b3484c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1511 microversion: 2.1 time: 0.404261 Aug 18 11:04:42.860501 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 157/305] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:42 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:43.252796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3f2de37f-445b-4c70-a225-cd365bdb10e0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:43.255309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3f2de37f-445b-4c70-a225-cd365bdb10e0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:43.277265 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3f2de37f-445b-4c70-a225-cd365bdb10e0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:43.278120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3f2de37f-445b-4c70-a225-cd365bdb10e0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:43.282622 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3f2de37f-445b-4c70-a225-cd365bdb10e0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:43.283394 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3f2de37f-445b-4c70-a225-cd365bdb10e0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:43.283873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3f2de37f-445b-4c70-a225-cd365bdb10e0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:43.284878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3f2de37f-445b-4c70-a225-cd365bdb10e0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:43.401962 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3f2de37f-445b-4c70-a225-cd365bdb10e0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:04:43.572657 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3f2de37f-445b-4c70-a225-cd365bdb10e0 tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 204 len: 0 microversion: 2.1 time: 0.324430 Aug 18 11:04:43.573778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 149/306] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:04:43 2022] DELETE /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:04:43.583888 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bec0cdf4-1f5e-41cf-86ed-b645badfd46d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:43.585948 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bec0cdf4-1f5e-41cf-86ed-b645badfd46d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:43.612015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bec0cdf4-1f5e-41cf-86ed-b645badfd46d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:43.613047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bec0cdf4-1f5e-41cf-86ed-b645badfd46d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:43.613487 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bec0cdf4-1f5e-41cf-86ed-b645badfd46d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:43.622291 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bec0cdf4-1f5e-41cf-86ed-b645badfd46d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:43.622939 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bec0cdf4-1f5e-41cf-86ed-b645badfd46d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:43.627119 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bec0cdf4-1f5e-41cf-86ed-b645badfd46d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:43.885533 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0bc4979d-53e8-44c5-8157-44f463068c5e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:43.886239 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0bc4979d-53e8-44c5-8157-44f463068c5e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:43.907029 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0bc4979d-53e8-44c5-8157-44f463068c5e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:43.907557 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0bc4979d-53e8-44c5-8157-44f463068c5e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:43.908006 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0bc4979d-53e8-44c5-8157-44f463068c5e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:43.911005 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0bc4979d-53e8-44c5-8157-44f463068c5e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:43.913057 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0bc4979d-53e8-44c5-8157-44f463068c5e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:43.913540 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0bc4979d-53e8-44c5-8157-44f463068c5e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:44.197433 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0bc4979d-53e8-44c5-8157-44f463068c5e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:44.222304 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0bc4979d-53e8-44c5-8157-44f463068c5e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1517 microversion: 2.1 time: 0.340600 Aug 18 11:04:44.223425 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 150/307] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:43 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1517 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:44.244224 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bec0cdf4-1f5e-41cf-86ed-b645badfd46d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:44.256319 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bec0cdf4-1f5e-41cf-86ed-b645badfd46d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1503 microversion: 2.1 time: 0.675341 Aug 18 11:04:44.257235 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 158/308] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:43 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1503 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:45.276340 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f4ba5b9b-59e8-47b5-a9a6-52abd8e4078d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:45.276960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f4ba5b9b-59e8-47b5-a9a6-52abd8e4078d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:45.290395 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4ba5b9b-59e8-47b5-a9a6-52abd8e4078d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:45.291208 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4ba5b9b-59e8-47b5-a9a6-52abd8e4078d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:45.291789 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4ba5b9b-59e8-47b5-a9a6-52abd8e4078d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:45.293259 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4ba5b9b-59e8-47b5-a9a6-52abd8e4078d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:45.294275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4ba5b9b-59e8-47b5-a9a6-52abd8e4078d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:45.297754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4ba5b9b-59e8-47b5-a9a6-52abd8e4078d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:45.527995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f4ba5b9b-59e8-47b5-a9a6-52abd8e4078d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:45.538693 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f4ba5b9b-59e8-47b5-a9a6-52abd8e4078d tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1503 microversion: 2.1 time: 0.266128 Aug 18 11:04:45.552641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 151/309] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:45 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:46.069158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-159eab32-0487-4bb1-9e9e-0b36943696fc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'create', calling method: .version_select at 0x7f7ec96f1af0>, body: {"keypair": {"name": "tempest-keypair-237348917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKz/3AFdMz4+dfBQrOA6FKQv/4icwOI1Bk5Ki6CHcH9NZ1XyGiQgEi4dtn8emJUXfB9DoYiGrcBcHdPb0RK0Q1tn8vQLwlRE2HWp2kdh149wh1ydxZ8SU81LIditsBV2A=="}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:46.096189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-159eab32-0487-4bb1-9e9e-0b36943696fc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Getting quotas for project ae09c11177204226a2aa5bb600ee575b. Resources: {'key_pairs'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:04:46.101777 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-159eab32-0487-4bb1-9e9e-0b36943696fc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Getting quotas for user 074cfcc7943349a490b29cd4ae3364cb and project ae09c11177204226a2aa5bb600ee575b. Resources: {'key_pairs'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:04:46.181414 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-159eab32-0487-4bb1-9e9e-0b36943696fc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117415 Aug 18 11:04:46.188458 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 159/310] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Aug 18 11:04:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:04:46.560283 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-bf0af780-2076-4fc3-9c7a-e49bbf79a6cd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:46.560898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-bf0af780-2076-4fc3-9c7a-e49bbf79a6cd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:46.563657 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:46.586592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf0af780-2076-4fc3-9c7a-e49bbf79a6cd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:46.587107 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf0af780-2076-4fc3-9c7a-e49bbf79a6cd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:46.587558 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf0af780-2076-4fc3-9c7a-e49bbf79a6cd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:46.588276 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf0af780-2076-4fc3-9c7a-e49bbf79a6cd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:46.588743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf0af780-2076-4fc3-9c7a-e49bbf79a6cd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:46.589175 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf0af780-2076-4fc3-9c7a-e49bbf79a6cd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:47.000685 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bf0af780-2076-4fc3-9c7a-e49bbf79a6cd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea5b4501d934e1bbfd6d46577d09e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd591dc6849c641888dbd28827a629d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:47.010013 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-bf0af780-2076-4fc3-9c7a-e49bbf79a6cd tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 200 len: 1503 microversion: 2.1 time: 0.453336 Aug 18 11:04:47.010934 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 152/311] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:46 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:47.026333 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-88ce0eea-8013-44be-8055-36799fc742e8 req-ce2e908d-6935-43d3-8911-e01cc5c1e8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19e050b-36af-4e08-80e0-9e295807be45", "name": "network-vif-deleted", "tag": "17052100-3aed-4863-bdf1-88e17e1aed07"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:47.055446 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-88ce0eea-8013-44be-8055-36799fc742e8 req-ce2e908d-6935-43d3-8911-e01cc5c1e8cd service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:47.056492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-88ce0eea-8013-44be-8055-36799fc742e8 req-ce2e908d-6935-43d3-8911-e01cc5c1e8cd service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:47.064841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-88ce0eea-8013-44be-8055-36799fc742e8 req-ce2e908d-6935-43d3-8911-e01cc5c1e8cd service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:47.078144 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-88ce0eea-8013-44be-8055-36799fc742e8 req-ce2e908d-6935-43d3-8911-e01cc5c1e8cd service nova] Creating event network-vif-deleted:17052100-3aed-4863-bdf1-88e17e1aed07 for instance f19e050b-36af-4e08-80e0-9e295807be45 on hv-cinder-82660 Aug 18 11:04:47.088698 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-88ce0eea-8013-44be-8055-36799fc742e8 req-ce2e908d-6935-43d3-8911-e01cc5c1e8cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074486 Aug 18 11:04:47.091070 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 153/312] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:04:47.555470 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bfd1167a-ea70-4873-9b08-224ed67f4baf tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Action: 'create', calling method: .version_select at 0x7f7ec9499c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1320507456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNysYwpfjG60s4qTX30F1AeTPAofSJVZOuBl6L9pYwU4a6WACTKIggutPiRlS42/nMHZ/cnIJOfdYn4dfTjBuaH62iIhv9MSbla2Is7fBTfdUkH8RlYLOOaNJh3LDSABwA=="}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:47.561790 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:47.592399 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-bfd1167a-ea70-4873-9b08-224ed67f4baf tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Getting quotas for project f20ffd1ca0c94a9285f1fad07e8ab39a. Resources: {'key_pairs'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:04:47.598949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-bfd1167a-ea70-4873-9b08-224ed67f4baf tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Getting quotas for user b6e7022d0e4c4b00b92f12a65963d9e9 and project f20ffd1ca0c94a9285f1fad07e8ab39a. Resources: {'key_pairs'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:04:47.638933 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bfd1167a-ea70-4873-9b08-224ed67f4baf tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.843116 Aug 18 11:04:47.640439 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 160/313] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Aug 18 11:04:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:04:48.046869 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:48.047767 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] [instance: f19e050b-36af-4e08-80e0-9e295807be45] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:48.064827 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:48.066813 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:48.067717 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:48.068808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:48.069494 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:48.070140 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:48.077479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:48.093175 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] HTTP exception thrown: Instance f19e050b-36af-4e08-80e0-9e295807be45 could not be found. Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Request method failure captured: Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 HTTP/1.1 Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hyIzSDcFqHIKQHJhLJHo5zk_iwJeXXX-v1oUdqAXAUF_7mWgIdFaTRAtzADA2I6b-xsqTJWFhE6lwTUUPYU2TWTsJuwXzaRJOXAmeqgSyQeF407BLF6nyRkZk1AfMc3GvCrYJRqZV62v68ZMKS0a3pCrMGofogGqILDGAZHw-RQJG8 Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: d591dc6849c641888dbd28827a629d31 Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-VolumesActionsTest-915252765 Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:04:48.098329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d591dc6849c641888dbd28827a629d31", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d591dc6849c641888dbd28827a629d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d591dc6849c641888dbd28827a629d31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d591dc6849c641888dbd28827a629d31"}]}] Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-VolumesActionsTest-915252765 Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: d591dc6849c641888dbd28827a629d31 Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-VolumesActionsTest-915252765 Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-VolumesActionsTest-915252765-project Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 2ea5b4501d934e1bbfd6d46577d09e5d Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-VolumesActionsTest-915252765-project Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance f19e050b-36af-4e08-80e0-9e295807be45 could not be found. Aug 18 11:04:48.099595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'f19e050b-36af-4e08-80e0-9e295807be45'} Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f19e050b-36af-4e08-80e0-9e295807be45 could not be found. Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:04:48.100255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f19e050b-36af-4e08-80e0-9e295807be45 could not be found. Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f19e050b-36af-4e08-80e0-9e295807be45 could not be found. Aug 18 11:04:48.101456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:04:48.103759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] Returning 404 to user: Instance f19e050b-36af-4e08-80e0-9e295807be45 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:04:48.104905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7fb8b023-b99e-4c82-8cea-e22d5378db2e tempest-VolumesActionsTest-915252765 tempest-VolumesActionsTest-915252765-project] 10.222.0.15 "GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45" status: 404 len: 111 microversion: 2.1 time: 0.072133 Aug 18 11:04:48.106123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 154/314] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:48 2022] GET /compute/v2.1/servers/f19e050b-36af-4e08-80e0-9e295807be45 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:04:50.137859 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1760655094", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a9abce7-f2b6-498b-a66c-e1abdcf1f879"}], "security_groups": [{"name": "tempest-securitygroup--1624453406"}], "key_name": "tempest-keypair-237348917", "user_data": "}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:50.325426 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.network.neutron [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] validate_networks() for [('7a9abce7-f2b6-498b-a66c-e1abdcf1f879', None, None, None, None, None)] {{(pid=120800) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:04:50.855451 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Flavor limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:04:50.856030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Image limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:04:50.857182 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Flavor pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:04:50.859112 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Image pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:04:50.859840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:04:50.874813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:50.875506 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:50.876855 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:50.878036 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:50.879892 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:50.880640 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:50.917304 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Getting quotas for project ae09c11177204226a2aa5bb600ee575b. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:04:50.923297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Getting quotas for user 074cfcc7943349a490b29cd4ae3364cb and project ae09c11177204226a2aa5bb600ee575b. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:04:50.939505 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Going to run 1 instances... {{(pid=120800) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:04:50.945550 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:04:51.041293 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-345aa1e7-eb3f-4eee-893c-98cc48051196 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.907776 Aug 18 11:04:51.045840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 161/315] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:04:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:04:51.059571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-66798d8a-8fb8-48c5-975f-f97289edb853 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:51.061053 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-66798d8a-8fb8-48c5-975f-f97289edb853 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:51.232060 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-66798d8a-8fb8-48c5-975f-f97289edb853 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:51.244293 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-66798d8a-8fb8-48c5-975f-f97289edb853 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1245 microversion: 2.1 time: 0.189704 Aug 18 11:04:51.246683 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 155/316] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:51 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1245 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:51.788205 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e4b400e8-b4a0-4524-ac2f-ef1f06778f9d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:51.788749 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e4b400e8-b4a0-4524-ac2f-ef1f06778f9d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:51.795780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e4b400e8-b4a0-4524-ac2f-ef1f06778f9d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:51.796325 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e4b400e8-b4a0-4524-ac2f-ef1f06778f9d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:51.796863 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e4b400e8-b4a0-4524-ac2f-ef1f06778f9d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:51.798530 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e4b400e8-b4a0-4524-ac2f-ef1f06778f9d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:51.798530 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e4b400e8-b4a0-4524-ac2f-ef1f06778f9d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:51.798530 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e4b400e8-b4a0-4524-ac2f-ef1f06778f9d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:51.814123 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=100 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:04:51.825401 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e4b400e8-b4a0-4524-ac2f-ef1f06778f9d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/ips" status: 200 len: 152 microversion: 2.20 time: 0.041837 Aug 18 11:04:51.826346 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 162/317] 10.222.0.15 () {60 vars in 1289 bytes} [Thu Aug 18 11:04:51 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:04:52.272800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-bd4c8441-fa9e-4931-b3d6-6a5b14a0c169 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:52.274058 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-bd4c8441-fa9e-4931-b3d6-6a5b14a0c169 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:52.282214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bd4c8441-fa9e-4931-b3d6-6a5b14a0c169 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:52.282701 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bd4c8441-fa9e-4931-b3d6-6a5b14a0c169 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:52.283135 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bd4c8441-fa9e-4931-b3d6-6a5b14a0c169 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:52.283829 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bd4c8441-fa9e-4931-b3d6-6a5b14a0c169 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:52.284783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bd4c8441-fa9e-4931-b3d6-6a5b14a0c169 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:52.285200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bd4c8441-fa9e-4931-b3d6-6a5b14a0c169 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:52.356320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bd4c8441-fa9e-4931-b3d6-6a5b14a0c169 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:52.364052 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-bd4c8441-fa9e-4931-b3d6-6a5b14a0c169 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1249 microversion: 2.1 time: 0.094968 Aug 18 11:04:52.364613 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 156/318] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:52 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:53.384834 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-94c1a7e7-df64-4086-a847-18e3118de0cb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:53.385461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-94c1a7e7-df64-4086-a847-18e3118de0cb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:53.391649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-94c1a7e7-df64-4086-a847-18e3118de0cb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:53.392134 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-94c1a7e7-df64-4086-a847-18e3118de0cb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:53.393058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-94c1a7e7-df64-4086-a847-18e3118de0cb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:53.394080 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-94c1a7e7-df64-4086-a847-18e3118de0cb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:53.394541 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-94c1a7e7-df64-4086-a847-18e3118de0cb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:53.394965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-94c1a7e7-df64-4086-a847-18e3118de0cb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:53.469742 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-94c1a7e7-df64-4086-a847-18e3118de0cb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:53.477953 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-94c1a7e7-df64-4086-a847-18e3118de0cb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1241 microversion: 2.1 time: 0.096921 Aug 18 11:04:53.478531 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 163/319] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:53 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:54.501416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0951377a-6a52-406a-8f42-0dafb4706ddf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:54.502081 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0951377a-6a52-406a-8f42-0dafb4706ddf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:54.511854 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0951377a-6a52-406a-8f42-0dafb4706ddf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:54.512359 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0951377a-6a52-406a-8f42-0dafb4706ddf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:54.512801 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0951377a-6a52-406a-8f42-0dafb4706ddf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:54.513739 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0951377a-6a52-406a-8f42-0dafb4706ddf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:54.514541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0951377a-6a52-406a-8f42-0dafb4706ddf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:54.516171 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0951377a-6a52-406a-8f42-0dafb4706ddf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:54.605778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0951377a-6a52-406a-8f42-0dafb4706ddf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:54.616678 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0951377a-6a52-406a-8f42-0dafb4706ddf tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1303 microversion: 2.1 time: 0.117584 Aug 18 11:04:54.617381 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 157/320] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:54 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:55.360017 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b83ee08e-45ea-4e20-a462-c05c79fa62ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:55.361141 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b83ee08e-45ea-4e20-a462-c05c79fa62ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:55.367593 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b83ee08e-45ea-4e20-a462-c05c79fa62ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:55.368084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b83ee08e-45ea-4e20-a462-c05c79fa62ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:55.368530 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b83ee08e-45ea-4e20-a462-c05c79fa62ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:55.369207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b83ee08e-45ea-4e20-a462-c05c79fa62ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:55.369682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b83ee08e-45ea-4e20-a462-c05c79fa62ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:55.370097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b83ee08e-45ea-4e20-a462-c05c79fa62ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:55.398222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b83ee08e-45ea-4e20-a462-c05c79fa62ed tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/ips" status: 200 len: 149 microversion: 2.1 time: 0.042302 Aug 18 11:04:55.405646 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 164/321] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Aug 18 11:04:55 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:04:55.584556 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9c523ee0-6111-40cc-b5ac-832ed7164b77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:55.585472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9c523ee0-6111-40cc-b5ac-832ed7164b77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:55.591913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9c523ee0-6111-40cc-b5ac-832ed7164b77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:55.592664 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9c523ee0-6111-40cc-b5ac-832ed7164b77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:55.593477 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9c523ee0-6111-40cc-b5ac-832ed7164b77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:55.594495 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9c523ee0-6111-40cc-b5ac-832ed7164b77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:55.595288 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9c523ee0-6111-40cc-b5ac-832ed7164b77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:55.595874 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9c523ee0-6111-40cc-b5ac-832ed7164b77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:55.630391 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-9c523ee0-6111-40cc-b5ac-832ed7164b77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lazy-loading 'flavor' on Instance uuid e210ba46-e81e-4939-b202-4b569f906d8b {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:04:55.640849 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5acad224-e0a8-4642-84b6-3492695f6dc6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:55.641465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5acad224-e0a8-4642-84b6-3492695f6dc6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:55.654191 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5acad224-e0a8-4642-84b6-3492695f6dc6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:55.656203 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5acad224-e0a8-4642-84b6-3492695f6dc6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:55.658656 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5acad224-e0a8-4642-84b6-3492695f6dc6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:55.661658 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5acad224-e0a8-4642-84b6-3492695f6dc6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:55.663527 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5acad224-e0a8-4642-84b6-3492695f6dc6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:55.664967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5acad224-e0a8-4642-84b6-3492695f6dc6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:55.837596 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5acad224-e0a8-4642-84b6-3492695f6dc6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:55.851682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5acad224-e0a8-4642-84b6-3492695f6dc6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.216513 Aug 18 11:04:55.852605 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 165/322] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:55 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:55.872677 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-0cef6e54-23ee-4077-9e41-ab276767a8c8 req-3448d2ba-5f1e-4585-8cdd-47be6010b0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0e5602-14b6-4ab8-b7b7-0e383adf09be", "tag": "f139b73f-bdbe-4491-9b26-2e2bb5aa8136"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:55.903503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0cef6e54-23ee-4077-9e41-ab276767a8c8 req-3448d2ba-5f1e-4585-8cdd-47be6010b0c0 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:55.904046 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0cef6e54-23ee-4077-9e41-ab276767a8c8 req-3448d2ba-5f1e-4585-8cdd-47be6010b0c0 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:55.904492 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0cef6e54-23ee-4077-9e41-ab276767a8c8 req-3448d2ba-5f1e-4585-8cdd-47be6010b0c0 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:55.928010 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-0cef6e54-23ee-4077-9e41-ab276767a8c8 req-3448d2ba-5f1e-4585-8cdd-47be6010b0c0 service nova] Creating event network-changed:f139b73f-bdbe-4491-9b26-2e2bb5aa8136 for instance db0e5602-14b6-4ab8-b7b7-0e383adf09be on hv-cinder-82660 Aug 18 11:04:55.948217 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-0cef6e54-23ee-4077-9e41-ab276767a8c8 req-3448d2ba-5f1e-4585-8cdd-47be6010b0c0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093667 Aug 18 11:04:55.949548 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 166/323] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:04:56.879997 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-99cb4352-412c-4de8-852d-4d1618551609 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:56.880750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-99cb4352-412c-4de8-852d-4d1618551609 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:56.891638 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99cb4352-412c-4de8-852d-4d1618551609 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:56.897058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99cb4352-412c-4de8-852d-4d1618551609 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:56.898443 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99cb4352-412c-4de8-852d-4d1618551609 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:56.899214 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99cb4352-412c-4de8-852d-4d1618551609 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:56.899698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99cb4352-412c-4de8-852d-4d1618551609 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:56.900454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99cb4352-412c-4de8-852d-4d1618551609 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:57.105997 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-99cb4352-412c-4de8-852d-4d1618551609 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:57.113958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-99cb4352-412c-4de8-852d-4d1618551609 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.240382 Aug 18 11:04:57.114550 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 167/324] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:56 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:04:57.127733 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-10a45850-a08f-4b35-b435-7d1b7d03252f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68f9e8a3-af98-49c1-9021-f31c1dfe55bb"}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:04:57.131395 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-10a45850-a08f-4b35-b435-7d1b7d03252f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:57.139992 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-10a45850-a08f-4b35-b435-7d1b7d03252f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:57.140477 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-10a45850-a08f-4b35-b435-7d1b7d03252f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:57.141448 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-10a45850-a08f-4b35-b435-7d1b7d03252f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:57.142203 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-10a45850-a08f-4b35-b435-7d1b7d03252f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:57.142836 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-10a45850-a08f-4b35-b435-7d1b7d03252f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:57.143778 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-10a45850-a08f-4b35-b435-7d1b7d03252f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:57.547584 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-10a45850-a08f-4b35-b435-7d1b7d03252f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430989 Aug 18 11:04:57.548642 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 168/325] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:04:57 2022] POST /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:04:58.137081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c3d3c348-0ca1-4e6e-9812-912c86a7b76f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:58.138004 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c3d3c348-0ca1-4e6e-9812-912c86a7b76f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:58.146176 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3d3c348-0ca1-4e6e-9812-912c86a7b76f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:58.146668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3d3c348-0ca1-4e6e-9812-912c86a7b76f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:58.147109 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3d3c348-0ca1-4e6e-9812-912c86a7b76f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:58.147819 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3d3c348-0ca1-4e6e-9812-912c86a7b76f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:58.148277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3d3c348-0ca1-4e6e-9812-912c86a7b76f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:58.148927 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c3d3c348-0ca1-4e6e-9812-912c86a7b76f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:58.304777 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c3d3c348-0ca1-4e6e-9812-912c86a7b76f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:58.313583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c3d3c348-0ca1-4e6e-9812-912c86a7b76f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.180650 Aug 18 11:04:58.314178 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 169/326] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:58 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:04:59.336213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-54089883-1c41-4609-b4b4-40e2da3f0c54 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:04:59.336966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-54089883-1c41-4609-b4b4-40e2da3f0c54 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:04:59.343648 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-54089883-1c41-4609-b4b4-40e2da3f0c54 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:59.344127 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-54089883-1c41-4609-b4b4-40e2da3f0c54 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:59.344608 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-54089883-1c41-4609-b4b4-40e2da3f0c54 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:59.345340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-54089883-1c41-4609-b4b4-40e2da3f0c54 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:04:59.345917 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-54089883-1c41-4609-b4b4-40e2da3f0c54 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:04:59.346449 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-54089883-1c41-4609-b4b4-40e2da3f0c54 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:04:59.499403 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-54089883-1c41-4609-b4b4-40e2da3f0c54 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:04:59.508768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-54089883-1c41-4609-b4b4-40e2da3f0c54 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.176553 Aug 18 11:04:59.509497 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 170/327] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:04:59 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:00.530431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3e32b5b5-2898-4ec2-baa6-fc9fdebf92b0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:00.531032 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3e32b5b5-2898-4ec2-baa6-fc9fdebf92b0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:00.538470 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e32b5b5-2898-4ec2-baa6-fc9fdebf92b0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:00.538964 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e32b5b5-2898-4ec2-baa6-fc9fdebf92b0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:00.539397 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e32b5b5-2898-4ec2-baa6-fc9fdebf92b0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:00.540094 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e32b5b5-2898-4ec2-baa6-fc9fdebf92b0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:00.540797 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e32b5b5-2898-4ec2-baa6-fc9fdebf92b0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:00.541224 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e32b5b5-2898-4ec2-baa6-fc9fdebf92b0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:00.678552 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3e32b5b5-2898-4ec2-baa6-fc9fdebf92b0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:00.686703 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3e32b5b5-2898-4ec2-baa6-fc9fdebf92b0 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.159959 Aug 18 11:05:00.687260 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 171/328] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:00 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:01.240253 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:01.707900 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5795657b-412b-4c84-8bbc-3eab5e1a9d80 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:01.708412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5795657b-412b-4c84-8bbc-3eab5e1a9d80 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:01.710411 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:01.711112 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=14 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:01.717731 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5795657b-412b-4c84-8bbc-3eab5e1a9d80 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:01.718225 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5795657b-412b-4c84-8bbc-3eab5e1a9d80 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:01.718665 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5795657b-412b-4c84-8bbc-3eab5e1a9d80 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:01.719363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5795657b-412b-4c84-8bbc-3eab5e1a9d80 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:01.719820 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5795657b-412b-4c84-8bbc-3eab5e1a9d80 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:01.720257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5795657b-412b-4c84-8bbc-3eab5e1a9d80 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:01.854173 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5795657b-412b-4c84-8bbc-3eab5e1a9d80 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:01.861545 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5795657b-412b-4c84-8bbc-3eab5e1a9d80 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.157588 Aug 18 11:05:01.862903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 172/329] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:01 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:02.883204 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a939004c-c28b-4496-8a39-fcf687edaa9f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:02.883879 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a939004c-c28b-4496-8a39-fcf687edaa9f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:02.891796 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a939004c-c28b-4496-8a39-fcf687edaa9f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:02.892303 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a939004c-c28b-4496-8a39-fcf687edaa9f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:02.893253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a939004c-c28b-4496-8a39-fcf687edaa9f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:02.894010 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a939004c-c28b-4496-8a39-fcf687edaa9f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:02.894501 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a939004c-c28b-4496-8a39-fcf687edaa9f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:02.894929 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a939004c-c28b-4496-8a39-fcf687edaa9f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:03.060015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a939004c-c28b-4496-8a39-fcf687edaa9f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:03.069812 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a939004c-c28b-4496-8a39-fcf687edaa9f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.190349 Aug 18 11:05:03.070593 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 173/330] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:02 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:04.094922 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a7213f99-2698-4593-8395-39f2e5504b21 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:04.095554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a7213f99-2698-4593-8395-39f2e5504b21 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:04.104300 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7213f99-2698-4593-8395-39f2e5504b21 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:04.104969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7213f99-2698-4593-8395-39f2e5504b21 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:04.105422 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7213f99-2698-4593-8395-39f2e5504b21 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:04.106280 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7213f99-2698-4593-8395-39f2e5504b21 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:04.106968 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7213f99-2698-4593-8395-39f2e5504b21 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:04.107756 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7213f99-2698-4593-8395-39f2e5504b21 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:04.270430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a7213f99-2698-4593-8395-39f2e5504b21 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:04.278207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a7213f99-2698-4593-8395-39f2e5504b21 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.189079 Aug 18 11:05:04.281702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 174/331] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:04 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:05.299166 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-331f4b2d-669b-48a1-a077-b4a660e516b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:05.300519 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-331f4b2d-669b-48a1-a077-b4a660e516b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:05.306912 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-331f4b2d-669b-48a1-a077-b4a660e516b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:05.307396 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-331f4b2d-669b-48a1-a077-b4a660e516b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:05.307834 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-331f4b2d-669b-48a1-a077-b4a660e516b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:05.308523 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-331f4b2d-669b-48a1-a077-b4a660e516b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:05.308976 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-331f4b2d-669b-48a1-a077-b4a660e516b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:05.309398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-331f4b2d-669b-48a1-a077-b4a660e516b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:05.455083 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-331f4b2d-669b-48a1-a077-b4a660e516b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:05.463144 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-331f4b2d-669b-48a1-a077-b4a660e516b8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.167790 Aug 18 11:05:05.463699 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 175/332] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:05 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:05.591129 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=15 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:05.749848 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:06.485772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6a45fa6b-2485-4f9a-b236-2ccaedc9c9a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:06.486382 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6a45fa6b-2485-4f9a-b236-2ccaedc9c9a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:06.492706 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a45fa6b-2485-4f9a-b236-2ccaedc9c9a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:06.493187 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a45fa6b-2485-4f9a-b236-2ccaedc9c9a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:06.493650 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a45fa6b-2485-4f9a-b236-2ccaedc9c9a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:06.494518 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a45fa6b-2485-4f9a-b236-2ccaedc9c9a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:06.494979 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a45fa6b-2485-4f9a-b236-2ccaedc9c9a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:06.495403 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6a45fa6b-2485-4f9a-b236-2ccaedc9c9a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:06.627109 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6a45fa6b-2485-4f9a-b236-2ccaedc9c9a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:06.636011 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6a45fa6b-2485-4f9a-b236-2ccaedc9c9a5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.154491 Aug 18 11:05:06.636602 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 176/333] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:06 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:07.658079 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-37aa9e8d-c3ac-40b7-9e22-a01261997e6d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:07.659430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-37aa9e8d-c3ac-40b7-9e22-a01261997e6d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:07.666256 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-37aa9e8d-c3ac-40b7-9e22-a01261997e6d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:07.666742 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-37aa9e8d-c3ac-40b7-9e22-a01261997e6d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:07.667185 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-37aa9e8d-c3ac-40b7-9e22-a01261997e6d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:07.667879 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-37aa9e8d-c3ac-40b7-9e22-a01261997e6d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:07.668337 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-37aa9e8d-c3ac-40b7-9e22-a01261997e6d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:07.668767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-37aa9e8d-c3ac-40b7-9e22-a01261997e6d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:07.813748 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-37aa9e8d-c3ac-40b7-9e22-a01261997e6d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:07.821843 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-37aa9e8d-c3ac-40b7-9e22-a01261997e6d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.167692 Aug 18 11:05:07.822428 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 177/334] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:07 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:08.843931 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7a07c2e3-de84-4853-ab1d-ae08ee4b583b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:08.844787 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7a07c2e3-de84-4853-ab1d-ae08ee4b583b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:08.851959 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a07c2e3-de84-4853-ab1d-ae08ee4b583b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:08.852478 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a07c2e3-de84-4853-ab1d-ae08ee4b583b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:08.852911 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a07c2e3-de84-4853-ab1d-ae08ee4b583b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:08.853632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a07c2e3-de84-4853-ab1d-ae08ee4b583b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:08.854086 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a07c2e3-de84-4853-ab1d-ae08ee4b583b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:08.854535 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a07c2e3-de84-4853-ab1d-ae08ee4b583b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:08.999767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7a07c2e3-de84-4853-ab1d-ae08ee4b583b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:09.009061 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7a07c2e3-de84-4853-ab1d-ae08ee4b583b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.169149 Aug 18 11:05:09.009672 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 178/335] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:08 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:09.433656 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-28f91729-b17e-48f9-94f4-b6a33f0790f7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: .version_select at 0x7f7ec943eb80>, body: {"keypair": {"name": "tempest-keypair-272890334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtpmXRa+AeCHrXbZj83MYkzWelQSZ+zElugLlhQ6ZaEgn6rylpZ8NwK3+fWdmvsUrl0aKrhQBasGEfbxxiv6w1F+6DTMMDxAEJanpbkh7Q7KLwaDx+Q5FH1H909lfDoEQ=="}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:09.449256 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-28f91729-b17e-48f9-94f4-b6a33f0790f7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for project 397eac573c2d473e881b07c87255700c. Resources: {'key_pairs'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:05:09.453055 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-28f91729-b17e-48f9-94f4-b6a33f0790f7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for user 57e117589fc14e4d9d8d8494bddf9c12 and project 397eac573c2d473e881b07c87255700c. Resources: {'key_pairs'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:05:09.493018 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-28f91729-b17e-48f9-94f4-b6a33f0790f7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063710 Aug 18 11:05:09.493943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 179/336] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Aug 18 11:05:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:05:10.032112 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-36b9a066-cd53-4b92-995b-a3e4883d25ca tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:10.032772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-36b9a066-cd53-4b92-995b-a3e4883d25ca tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:10.041731 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36b9a066-cd53-4b92-995b-a3e4883d25ca tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:10.042231 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36b9a066-cd53-4b92-995b-a3e4883d25ca tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:10.042859 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36b9a066-cd53-4b92-995b-a3e4883d25ca tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:10.043565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36b9a066-cd53-4b92-995b-a3e4883d25ca tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:10.044024 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36b9a066-cd53-4b92-995b-a3e4883d25ca tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:10.044447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36b9a066-cd53-4b92-995b-a3e4883d25ca tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:10.047301 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:10.271326 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-36b9a066-cd53-4b92-995b-a3e4883d25ca tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:10.279749 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-36b9a066-cd53-4b92-995b-a3e4883d25ca tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.252027 Aug 18 11:05:10.280426 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 180/337] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:10 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:11.203084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-683166518", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88f1fd75-57ea-4549-97f2-02b6b8fc6e1b"}], "security_groups": [{"name": "tempest-securitygroup--969103028"}], "key_name": "tempest-keypair-272890334", "user_data": "}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:19.459917 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=4 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:20.276628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=5 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:20.519072 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9c523ee0-6111-40cc-b5ac-832ed7164b77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "POST /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/action" status: 202 len: 0 microversion: 2.20 time: 24.939356 Aug 18 11:05:20.521731 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 158/338] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Aug 18 11:04:55 2022] POST /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/action => generated 0 bytes in 24943 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:05:20.527372 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-433ce8e7-60cd-4dd0-b9a3-ebdddeade468 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:20.528057 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-433ce8e7-60cd-4dd0-b9a3-ebdddeade468 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:20.536028 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-433ce8e7-60cd-4dd0-b9a3-ebdddeade468 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:20.536773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-433ce8e7-60cd-4dd0-b9a3-ebdddeade468 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:20.537366 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-433ce8e7-60cd-4dd0-b9a3-ebdddeade468 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:20.538280 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-433ce8e7-60cd-4dd0-b9a3-ebdddeade468 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:20.538731 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-433ce8e7-60cd-4dd0-b9a3-ebdddeade468 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:20.539371 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-433ce8e7-60cd-4dd0-b9a3-ebdddeade468 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:20.576007 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.network.neutron [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] validate_networks() for [('88f1fd75-57ea-4549-97f2-02b6b8fc6e1b', None, None, None, None, None)] {{(pid=120800) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:05:20.686013 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-433ce8e7-60cd-4dd0-b9a3-ebdddeade468 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:20.694687 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-433ce8e7-60cd-4dd0-b9a3-ebdddeade468 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.171617 Aug 18 11:05:20.708064 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 159/339] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:20 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:20.708064 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:20.708064 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:20.708064 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:20.708636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:20.708636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:20.708636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:20.708874 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:20.709254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:20.766148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:20.845304 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:20.854527 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:20.856046 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:20.857249 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4cf82ba3-247f-453a-aa3e-5037913a74cd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.161036 Aug 18 11:05:20.858234 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 160/340] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:20 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:20.963674 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Flavor limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:05:20.964125 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Image limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:05:20.964704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Flavor pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:05:20.965148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Image pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:05:20.965616 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:05:20.974666 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:20.975148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:20.975571 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:20.976282 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:20.976732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:20.977149 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:20.996626 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for project 397eac573c2d473e881b07c87255700c. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:05:21.000541 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for user 57e117589fc14e4d9d8d8494bddf9c12 and project 397eac573c2d473e881b07c87255700c. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:05:21.011973 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Going to run 1 instances... {{(pid=120800) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:05:21.014316 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:05:21.063581 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2a2d6d81-ce68-4871-9160-8888d34640df tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 9.865841 Aug 18 11:05:21.064235 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 181/341] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:05:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 9867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:05:21.076100 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3d001a7a-0143-4260-8def-d44a8a34e165 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:21.076721 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3d001a7a-0143-4260-8def-d44a8a34e165 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:21.138685 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3d001a7a-0143-4260-8def-d44a8a34e165 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:21.146523 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3d001a7a-0143-4260-8def-d44a8a34e165 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1240 microversion: 2.1 time: 0.074076 Aug 18 11:05:21.147090 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 161/342] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:21 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:21.715370 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-242e9dc9-e1b5-4c5e-8e82-ad561c50722a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:21.715941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-242e9dc9-e1b5-4c5e-8e82-ad561c50722a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:21.722900 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-242e9dc9-e1b5-4c5e-8e82-ad561c50722a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:21.723384 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-242e9dc9-e1b5-4c5e-8e82-ad561c50722a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:21.723820 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-242e9dc9-e1b5-4c5e-8e82-ad561c50722a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:21.724509 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-242e9dc9-e1b5-4c5e-8e82-ad561c50722a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:21.724963 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-242e9dc9-e1b5-4c5e-8e82-ad561c50722a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:21.725383 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-242e9dc9-e1b5-4c5e-8e82-ad561c50722a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:21.864624 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-242e9dc9-e1b5-4c5e-8e82-ad561c50722a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:21.873021 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-242e9dc9-e1b5-4c5e-8e82-ad561c50722a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.162011 Aug 18 11:05:21.873616 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 182/343] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:21 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:21.881101 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:21.881734 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:21.889331 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:21.889847 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:21.890283 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:21.893111 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:21.893111 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:21.893111 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:22.025488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:22.033490 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:22.035034 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:22.036199 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-18871b29-dcab-4f11-b897-0afc4560dff1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.159226 Aug 18 11:05:22.036759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 162/344] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:21 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:22.166586 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-767fde0f-c36c-47ae-8622-0ce5d53e3ed1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:22.167195 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-767fde0f-c36c-47ae-8622-0ce5d53e3ed1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:22.173166 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-767fde0f-c36c-47ae-8622-0ce5d53e3ed1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:22.173694 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-767fde0f-c36c-47ae-8622-0ce5d53e3ed1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:22.174265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-767fde0f-c36c-47ae-8622-0ce5d53e3ed1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:22.175205 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-767fde0f-c36c-47ae-8622-0ce5d53e3ed1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:22.175657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-767fde0f-c36c-47ae-8622-0ce5d53e3ed1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:22.176084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-767fde0f-c36c-47ae-8622-0ce5d53e3ed1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:22.250525 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-767fde0f-c36c-47ae-8622-0ce5d53e3ed1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:22.258496 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-767fde0f-c36c-47ae-8622-0ce5d53e3ed1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1244 microversion: 2.1 time: 0.095998 Aug 18 11:05:22.259065 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 183/345] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:22 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:22.896974 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-12120044-9375-49eb-aaac-7c63e692d56b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:22.897626 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-12120044-9375-49eb-aaac-7c63e692d56b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:22.905114 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-12120044-9375-49eb-aaac-7c63e692d56b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:22.905706 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-12120044-9375-49eb-aaac-7c63e692d56b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:22.906173 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-12120044-9375-49eb-aaac-7c63e692d56b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:22.906969 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-12120044-9375-49eb-aaac-7c63e692d56b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:22.907444 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-12120044-9375-49eb-aaac-7c63e692d56b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:22.907905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-12120044-9375-49eb-aaac-7c63e692d56b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:23.062775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:23.064831 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:23.076016 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:23.076827 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:23.077931 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:23.079412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:23.080784 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:23.081943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:23.109294 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-12120044-9375-49eb-aaac-7c63e692d56b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:23.121409 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-12120044-9375-49eb-aaac-7c63e692d56b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.228838 Aug 18 11:05:23.123940 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 163/346] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:22 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:23.258099 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:23.267418 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:23.270015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:23.271152 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3903e7ba-e50f-465b-b579-a8fb114b2bea tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.215888 Aug 18 11:05:23.282105 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 184/347] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:23 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:05:23.284254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1f9b7bc2-9d7c-4702-9b70-a6e681338e15 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:23.285716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1f9b7bc2-9d7c-4702-9b70-a6e681338e15 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:23.300132 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1f9b7bc2-9d7c-4702-9b70-a6e681338e15 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:23.300737 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1f9b7bc2-9d7c-4702-9b70-a6e681338e15 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:23.301167 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1f9b7bc2-9d7c-4702-9b70-a6e681338e15 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:23.301921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1f9b7bc2-9d7c-4702-9b70-a6e681338e15 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:23.302469 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1f9b7bc2-9d7c-4702-9b70-a6e681338e15 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:23.302893 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1f9b7bc2-9d7c-4702-9b70-a6e681338e15 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:23.387656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1f9b7bc2-9d7c-4702-9b70-a6e681338e15 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:23.395977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1f9b7bc2-9d7c-4702-9b70-a6e681338e15 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1292 microversion: 2.1 time: 0.119690 Aug 18 11:05:23.396542 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 164/348] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:23 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1292 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:24.152564 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3e16e965-fe58-4234-b8de-0ad8967033f4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:24.153536 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3e16e965-fe58-4234-b8de-0ad8967033f4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:24.161322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e16e965-fe58-4234-b8de-0ad8967033f4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:24.161871 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e16e965-fe58-4234-b8de-0ad8967033f4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:24.162419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e16e965-fe58-4234-b8de-0ad8967033f4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:24.163135 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e16e965-fe58-4234-b8de-0ad8967033f4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:24.163901 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e16e965-fe58-4234-b8de-0ad8967033f4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:24.164331 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e16e965-fe58-4234-b8de-0ad8967033f4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:24.303303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:24.304746 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:24.327592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:24.328581 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:24.329978 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:24.331620 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:24.332677 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:24.333879 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:24.371815 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3e16e965-fe58-4234-b8de-0ad8967033f4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:24.389038 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3e16e965-fe58-4234-b8de-0ad8967033f4 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.240684 Aug 18 11:05:24.389846 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 185/349] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:24 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:24.420878 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-57747c1a-3bb7-419a-9950-32da3548a95e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:24.421913 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-57747c1a-3bb7-419a-9950-32da3548a95e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:24.433763 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-57747c1a-3bb7-419a-9950-32da3548a95e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:24.434326 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-57747c1a-3bb7-419a-9950-32da3548a95e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:24.436252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-57747c1a-3bb7-419a-9950-32da3548a95e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:24.437134 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-57747c1a-3bb7-419a-9950-32da3548a95e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:24.437640 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-57747c1a-3bb7-419a-9950-32da3548a95e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:24.438210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-57747c1a-3bb7-419a-9950-32da3548a95e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:24.616198 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:24.627754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:24.631136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:24.632765 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a42869ce-37cf-40c3-9fa6-30c4c128e489 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.336201 Aug 18 11:05:24.633537 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 165/350] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:24 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:05:24.638401 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-57747c1a-3bb7-419a-9950-32da3548a95e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:24.648621 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-57747c1a-3bb7-419a-9950-32da3548a95e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1292 microversion: 2.1 time: 0.233530 Aug 18 11:05:24.649189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 186/351] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:24 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1292 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:25.414575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e2cc8787-5d08-4b1a-afcb-1098016a6058 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:25.415337 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e2cc8787-5d08-4b1a-afcb-1098016a6058 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:25.422640 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e2cc8787-5d08-4b1a-afcb-1098016a6058 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:25.423440 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e2cc8787-5d08-4b1a-afcb-1098016a6058 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:25.424157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e2cc8787-5d08-4b1a-afcb-1098016a6058 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:25.425287 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e2cc8787-5d08-4b1a-afcb-1098016a6058 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:25.425985 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e2cc8787-5d08-4b1a-afcb-1098016a6058 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:25.426652 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e2cc8787-5d08-4b1a-afcb-1098016a6058 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:25.640609 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e2cc8787-5d08-4b1a-afcb-1098016a6058 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:25.652250 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e2cc8787-5d08-4b1a-afcb-1098016a6058 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.241431 Aug 18 11:05:25.665123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 166/352] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:25 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:25.670752 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:25.671552 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:25.675538 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0b0f69a7-e119-4fca-a5d5-484f9ef1d645 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:25.676640 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0b0f69a7-e119-4fca-a5d5-484f9ef1d645 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:25.683894 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b0f69a7-e119-4fca-a5d5-484f9ef1d645 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:25.685044 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b0f69a7-e119-4fca-a5d5-484f9ef1d645 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:25.685269 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:25.685801 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:25.686298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:25.686427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b0f69a7-e119-4fca-a5d5-484f9ef1d645 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:25.687479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b0f69a7-e119-4fca-a5d5-484f9ef1d645 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:25.687707 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:25.688312 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:25.688612 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b0f69a7-e119-4fca-a5d5-484f9ef1d645 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:25.688772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:25.689325 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0b0f69a7-e119-4fca-a5d5-484f9ef1d645 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:25.907830 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:25.919177 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:25.920862 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:25.922161 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-741086f1-d9a9-4a99-813c-9a0c9519cfe1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.255771 Aug 18 11:05:25.922783 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 187/353] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:25 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:05:26.021838 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0b0f69a7-e119-4fca-a5d5-484f9ef1d645 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:26.036657 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0b0f69a7-e119-4fca-a5d5-484f9ef1d645 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1365 microversion: 2.1 time: 0.361163 Aug 18 11:05:26.037553 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 167/354] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:25 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:26.679897 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ce8ea1b8-d8c8-4e4a-a3df-fb0d55ed0112 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:26.681674 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ce8ea1b8-d8c8-4e4a-a3df-fb0d55ed0112 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:26.692695 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ce8ea1b8-d8c8-4e4a-a3df-fb0d55ed0112 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:26.694794 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ce8ea1b8-d8c8-4e4a-a3df-fb0d55ed0112 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:26.696562 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ce8ea1b8-d8c8-4e4a-a3df-fb0d55ed0112 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:26.699158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ce8ea1b8-d8c8-4e4a-a3df-fb0d55ed0112 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:26.700251 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ce8ea1b8-d8c8-4e4a-a3df-fb0d55ed0112 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:26.700866 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ce8ea1b8-d8c8-4e4a-a3df-fb0d55ed0112 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:26.905923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ce8ea1b8-d8c8-4e4a-a3df-fb0d55ed0112 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:26.916813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ce8ea1b8-d8c8-4e4a-a3df-fb0d55ed0112 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.243554 Aug 18 11:05:26.922084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 188/355] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:26 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:26.953568 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:26.955690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:26.969457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:26.970306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:26.971876 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:26.973370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:26.974176 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:26.974815 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:27.064206 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5f058989-0a57-46f2-8211-a9a1ad6e9e19 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:27.066262 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5f058989-0a57-46f2-8211-a9a1ad6e9e19 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:27.078620 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f058989-0a57-46f2-8211-a9a1ad6e9e19 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:27.079895 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f058989-0a57-46f2-8211-a9a1ad6e9e19 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:27.081240 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f058989-0a57-46f2-8211-a9a1ad6e9e19 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:27.083230 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f058989-0a57-46f2-8211-a9a1ad6e9e19 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:27.084094 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f058989-0a57-46f2-8211-a9a1ad6e9e19 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:27.084878 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f058989-0a57-46f2-8211-a9a1ad6e9e19 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:27.231268 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:27.249986 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:27.254559 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:27.257770 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8909dfd0-6467-48ea-bf02-e90e1080d631 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.308944 Aug 18 11:05:27.270448 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 168/356] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:26 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:27.308084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5f058989-0a57-46f2-8211-a9a1ad6e9e19 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:27.320496 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5f058989-0a57-46f2-8211-a9a1ad6e9e19 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1365 microversion: 2.1 time: 0.262091 Aug 18 11:05:27.322335 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 189/357] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:27 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:27.355413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-ce432948-6965-4443-b099-6151c79f9399 req-9699219f-2b67-410f-9964-60501e6c0de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f24c60c-50af-4a18-bd0a-20de259bc3c8", "tag": "38d8f7be-04b7-4a8b-ab84-70a8f2444464"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:27.378382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-ce432948-6965-4443-b099-6151c79f9399 req-9699219f-2b67-410f-9964-60501e6c0de7 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:27.379428 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-ce432948-6965-4443-b099-6151c79f9399 req-9699219f-2b67-410f-9964-60501e6c0de7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:27.380549 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-ce432948-6965-4443-b099-6151c79f9399 req-9699219f-2b67-410f-9964-60501e6c0de7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:27.403611 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-ce432948-6965-4443-b099-6151c79f9399 req-9699219f-2b67-410f-9964-60501e6c0de7 service nova] Creating event network-changed:38d8f7be-04b7-4a8b-ab84-70a8f2444464 for instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 on hv-cinder-82660 Aug 18 11:05:27.413917 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-ce432948-6965-4443-b099-6151c79f9399 req-9699219f-2b67-410f-9964-60501e6c0de7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062038 Aug 18 11:05:27.414860 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 169/358] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:05:27.944884 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c78de192-b2ff-401b-ac73-27cce53b39f8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:27.945488 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c78de192-b2ff-401b-ac73-27cce53b39f8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:27.956435 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c78de192-b2ff-401b-ac73-27cce53b39f8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:27.956890 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c78de192-b2ff-401b-ac73-27cce53b39f8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:27.959354 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c78de192-b2ff-401b-ac73-27cce53b39f8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:27.961370 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c78de192-b2ff-401b-ac73-27cce53b39f8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:27.963949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c78de192-b2ff-401b-ac73-27cce53b39f8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:27.964547 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c78de192-b2ff-401b-ac73-27cce53b39f8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:28.125743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-454d207f-492c-4bd5-8da3-510f454f1bac req-8fbff1af-c776-492e-8979-799ef1384e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0e5602-14b6-4ab8-b7b7-0e383adf09be", "name": "network-vif-plugged", "status": "completed", "tag": "f139b73f-bdbe-4491-9b26-2e2bb5aa8136"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:28.187604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-454d207f-492c-4bd5-8da3-510f454f1bac req-8fbff1af-c776-492e-8979-799ef1384e8b service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:28.188654 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-454d207f-492c-4bd5-8da3-510f454f1bac req-8fbff1af-c776-492e-8979-799ef1384e8b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:28.191157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-454d207f-492c-4bd5-8da3-510f454f1bac req-8fbff1af-c776-492e-8979-799ef1384e8b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:28.238789 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-454d207f-492c-4bd5-8da3-510f454f1bac req-8fbff1af-c776-492e-8979-799ef1384e8b service nova] Creating event network-vif-plugged:f139b73f-bdbe-4491-9b26-2e2bb5aa8136 for instance db0e5602-14b6-4ab8-b7b7-0e383adf09be on hv-cinder-82660 Aug 18 11:05:28.260699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-454d207f-492c-4bd5-8da3-510f454f1bac req-8fbff1af-c776-492e-8979-799ef1384e8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140820 Aug 18 11:05:28.267141 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 170/359] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:05:28.292759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:28.294984 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:28.305796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:28.306996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:28.307855 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:28.309898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:28.310931 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:28.311906 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:28.348691 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c78de192-b2ff-401b-ac73-27cce53b39f8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:28.367144 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c78de192-b2ff-401b-ac73-27cce53b39f8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.426343 Aug 18 11:05:28.369535 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 190/360] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:27 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:28.394511 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9f43b8a8-e94e-4d9d-8683-454be3b4de1d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:28.395426 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9f43b8a8-e94e-4d9d-8683-454be3b4de1d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:28.404344 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9f43b8a8-e94e-4d9d-8683-454be3b4de1d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:28.404995 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9f43b8a8-e94e-4d9d-8683-454be3b4de1d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:28.407489 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9f43b8a8-e94e-4d9d-8683-454be3b4de1d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:28.410427 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9f43b8a8-e94e-4d9d-8683-454be3b4de1d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:28.411196 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9f43b8a8-e94e-4d9d-8683-454be3b4de1d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:28.412465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9f43b8a8-e94e-4d9d-8683-454be3b4de1d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:28.583522 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:28.596661 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9f43b8a8-e94e-4d9d-8683-454be3b4de1d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:28.599482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:28.610009 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:28.611518 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9f43b8a8-e94e-4d9d-8683-454be3b4de1d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1365 microversion: 2.1 time: 0.239737 Aug 18 11:05:28.613151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6e103362-887c-4689-8d25-3117e992af7f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.330037 Aug 18 11:05:28.629560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 191/361] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:28 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:28.630457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 171/362] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:28 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:05:29.404205 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ed88c4ba-d5bb-4a81-8967-2d694a898b03 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:29.405284 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ed88c4ba-d5bb-4a81-8967-2d694a898b03 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:29.458247 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ed88c4ba-d5bb-4a81-8967-2d694a898b03 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:29.458759 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ed88c4ba-d5bb-4a81-8967-2d694a898b03 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:29.459200 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ed88c4ba-d5bb-4a81-8967-2d694a898b03 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:29.463356 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ed88c4ba-d5bb-4a81-8967-2d694a898b03 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:29.466894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ed88c4ba-d5bb-4a81-8967-2d694a898b03 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:29.468081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ed88c4ba-d5bb-4a81-8967-2d694a898b03 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:29.653370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-09e4bbeb-4488-4416-8257-3929d040b44d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:29.653983 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-09e4bbeb-4488-4416-8257-3929d040b44d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:29.668286 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-09e4bbeb-4488-4416-8257-3929d040b44d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:29.668286 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-09e4bbeb-4488-4416-8257-3929d040b44d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:29.668286 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-09e4bbeb-4488-4416-8257-3929d040b44d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:29.669150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-09e4bbeb-4488-4416-8257-3929d040b44d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:29.670141 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-09e4bbeb-4488-4416-8257-3929d040b44d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:29.670749 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-09e4bbeb-4488-4416-8257-3929d040b44d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:30.079783 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ed88c4ba-d5bb-4a81-8967-2d694a898b03 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:30.085620 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-09e4bbeb-4488-4416-8257-3929d040b44d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:30.097294 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ed88c4ba-d5bb-4a81-8967-2d694a898b03 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.698130 Aug 18 11:05:30.099543 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 192/363] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:29 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:30.103768 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-09e4bbeb-4488-4416-8257-3929d040b44d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1365 microversion: 2.1 time: 0.450784 Aug 18 11:05:30.104519 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 172/364] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:29 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:30.112750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:30.115370 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:30.133750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:30.134801 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:30.135547 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:30.136476 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:30.137089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:30.137753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:30.464237 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1021229971", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1320507456", "security_groups": [{"name": "tempest-secgroup-smoke-1637886222"}], "networks": [{"uuid": "b8c9d1a8-3dfa-431b-bc86-c38c954e0f57"}], "block_device_mapping_v2": [{"uuid": "d438940a-5ebf-4210-b635-cb2541db97a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:30.660227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:30.672977 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:30.683041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:30.685670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9081d4f6-97f6-45cc-9204-2d474dcaecec tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.584410 Aug 18 11:05:30.700360 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 193/365] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:30 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:30.749762 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] validate_networks() for [('b8c9d1a8-3dfa-431b-bc86-c38c954e0f57', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:05:31.120529 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e9298682-640c-43d4-bac5-5d014c552dbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:31.121566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e9298682-640c-43d4-bac5-5d014c552dbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:31.144063 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:31.149219 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:31.151676 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=6 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:31.156986 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e9298682-640c-43d4-bac5-5d014c552dbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:31.161974 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e9298682-640c-43d4-bac5-5d014c552dbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:31.163652 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e9298682-640c-43d4-bac5-5d014c552dbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:31.166691 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e9298682-640c-43d4-bac5-5d014c552dbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:31.167793 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e9298682-640c-43d4-bac5-5d014c552dbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:31.169327 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e9298682-640c-43d4-bac5-5d014c552dbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:31.510408 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e9298682-640c-43d4-bac5-5d014c552dbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:31.521788 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e9298682-640c-43d4-bac5-5d014c552dbc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1371 microversion: 2.1 time: 0.404802 Aug 18 11:05:31.533914 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 194/366] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:31 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:31.544210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2d12f81c-0fd7-47bc-a163-0b4b574c08be tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:31.544808 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2d12f81c-0fd7-47bc-a163-0b4b574c08be tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:31.546334 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:05:31.546942 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:05:31.547581 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:05:31.550015 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:05:31.551192 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:05:31.568571 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2d12f81c-0fd7-47bc-a163-0b4b574c08be tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:31.569076 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2d12f81c-0fd7-47bc-a163-0b4b574c08be tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:31.569549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2d12f81c-0fd7-47bc-a163-0b4b574c08be tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:31.571251 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2d12f81c-0fd7-47bc-a163-0b4b574c08be tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:31.571400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:31.571797 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:31.572241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:31.574551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2d12f81c-0fd7-47bc-a163-0b4b574c08be tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:31.575981 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:31.576496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:31.576932 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:31.578344 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2d12f81c-0fd7-47bc-a163-0b4b574c08be tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:31.623898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Getting quotas for project f20ffd1ca0c94a9285f1fad07e8ab39a. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:05:31.638757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Getting quotas for user b6e7022d0e4c4b00b92f12a65963d9e9 and project f20ffd1ca0c94a9285f1fad07e8ab39a. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:05:31.798196 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:05:31.801822 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d438940a-5ebf-4210-b635-cb2541db97a3',volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:05:31.994302 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2d12f81c-0fd7-47bc-a163-0b4b574c08be tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:32.007110 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2d12f81c-0fd7-47bc-a163-0b4b574c08be tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1365 microversion: 2.1 time: 0.479964 Aug 18 11:05:32.009438 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 195/367] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:31 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1365 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:32.031647 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:32.033867 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:32.045334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:32.047051 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:32.048002 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:32.050284 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:32.050914 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:32.052145 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:32.073243 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e6bc3dff-23b1-473a-a32d-589af079478a tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.613033 Aug 18 11:05:32.074935 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 173/368] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:05:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:05:32.087227 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4b951fd7-2694-4d16-92fc-f4465eeae844 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:32.088112 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4b951fd7-2694-4d16-92fc-f4465eeae844 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:32.185581 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4b951fd7-2694-4d16-92fc-f4465eeae844 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:32.192890 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4b951fd7-2694-4d16-92fc-f4465eeae844 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1089 microversion: 2.1 time: 0.109794 Aug 18 11:05:32.197858 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 174/369] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:32 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1089 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:32.518656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-658318e2-427b-4b43-8eff-daea663fb1c5 req-e5f25dcd-0530-4649-a300-a99354de0e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f24c60c-50af-4a18-bd0a-20de259bc3c8", "name": "network-vif-plugged", "status": "completed", "tag": "38d8f7be-04b7-4a8b-ab84-70a8f2444464"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:32.534000 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:32.537795 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-658318e2-427b-4b43-8eff-daea663fb1c5 req-e5f25dcd-0530-4649-a300-a99354de0e34 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:32.538540 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-658318e2-427b-4b43-8eff-daea663fb1c5 req-e5f25dcd-0530-4649-a300-a99354de0e34 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:32.539279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-658318e2-427b-4b43-8eff-daea663fb1c5 req-e5f25dcd-0530-4649-a300-a99354de0e34 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:32.547350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:32.552941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:32.557217 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e3688efa-7b32-4da4-a47e-b0ce005d281e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.545792 Aug 18 11:05:32.559623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 196/370] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:32 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:32.563428 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-658318e2-427b-4b43-8eff-daea663fb1c5 req-e5f25dcd-0530-4649-a300-a99354de0e34 service nova] Creating event network-vif-plugged:38d8f7be-04b7-4a8b-ab84-70a8f2444464 for instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 on hv-cinder-82660 Aug 18 11:05:32.571430 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-658318e2-427b-4b43-8eff-daea663fb1c5 req-e5f25dcd-0530-4649-a300-a99354de0e34 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060434 Aug 18 11:05:32.572689 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 175/371] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:05:32.574596 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fa0c1a5b-5853-469a-90fa-816b55bdc80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:32.575665 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fa0c1a5b-5853-469a-90fa-816b55bdc80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:32.586811 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fa0c1a5b-5853-469a-90fa-816b55bdc80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:32.587726 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fa0c1a5b-5853-469a-90fa-816b55bdc80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:32.588689 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fa0c1a5b-5853-469a-90fa-816b55bdc80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:32.590048 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fa0c1a5b-5853-469a-90fa-816b55bdc80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:32.592197 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fa0c1a5b-5853-469a-90fa-816b55bdc80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:32.593077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fa0c1a5b-5853-469a-90fa-816b55bdc80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:32.997306 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-fa0c1a5b-5853-469a-90fa-816b55bdc80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:33.007904 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fa0c1a5b-5853-469a-90fa-816b55bdc80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1566 microversion: 2.1 time: 0.445705 Aug 18 11:05:33.008897 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 197/372] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:32 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1566 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:33.039025 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3b6cac5a-dee3-46e0-907b-50c968118c51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:33.039606 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3b6cac5a-dee3-46e0-907b-50c968118c51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:33.039929 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3bc4da66-9fdb-463d-8334-a1364657e531 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:33.041054 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3bc4da66-9fdb-463d-8334-a1364657e531 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:33.056292 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b6cac5a-dee3-46e0-907b-50c968118c51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:33.056785 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b6cac5a-dee3-46e0-907b-50c968118c51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:33.057225 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b6cac5a-dee3-46e0-907b-50c968118c51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:33.058061 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b6cac5a-dee3-46e0-907b-50c968118c51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:33.060716 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bc4da66-9fdb-463d-8334-a1364657e531 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:33.061445 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bc4da66-9fdb-463d-8334-a1364657e531 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:33.063977 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bc4da66-9fdb-463d-8334-a1364657e531 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:33.065499 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bc4da66-9fdb-463d-8334-a1364657e531 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:33.066540 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b6cac5a-dee3-46e0-907b-50c968118c51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:33.066793 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bc4da66-9fdb-463d-8334-a1364657e531 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:33.066995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b6cac5a-dee3-46e0-907b-50c968118c51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:33.067561 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bc4da66-9fdb-463d-8334-a1364657e531 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:33.078248 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=100 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:33.243656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3b6cac5a-dee3-46e0-907b-50c968118c51 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215125 Aug 18 11:05:33.244564 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 176/373] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Aug 18 11:05:33 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:05:33.249072 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3bd0c049-1810-4db6-89d1-d35739af2b02 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:33.250148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3bd0c049-1810-4db6-89d1-d35739af2b02 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:33.263065 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3bd0c049-1810-4db6-89d1-d35739af2b02 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:33.265718 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3bd0c049-1810-4db6-89d1-d35739af2b02 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:33.266362 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3bd0c049-1810-4db6-89d1-d35739af2b02 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:33.270827 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3bd0c049-1810-4db6-89d1-d35739af2b02 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:33.271532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3bd0c049-1810-4db6-89d1-d35739af2b02 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:33.272352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3bd0c049-1810-4db6-89d1-d35739af2b02 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:33.441914 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3bd0c049-1810-4db6-89d1-d35739af2b02 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:33.451611 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3bd0c049-1810-4db6-89d1-d35739af2b02 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1131 microversion: 2.1 time: 0.205649 Aug 18 11:05:33.455649 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 177/374] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:33 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1131 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:33.587822 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:33.588945 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:33.600987 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:33.601928 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:33.604779 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:33.606104 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:33.607514 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:33.614522 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:33.890435 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3bc4da66-9fdb-463d-8334-a1364657e531 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:33.903809 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3bc4da66-9fdb-463d-8334-a1364657e531 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1365 microversion: 2.1 time: 0.874167 Aug 18 11:05:33.905070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 198/375] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:33 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1365 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:34.099541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:34.108684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:34.114372 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:34.116770 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-56e780dd-dea5-4148-b46f-f7ba30391636 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.533624 Aug 18 11:05:34.118432 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 178/376] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:33 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:05:34.483709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6bae067c-9644-4347-82d2-e271eae583d5 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:34.484441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6bae067c-9644-4347-82d2-e271eae583d5 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:34.496656 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bae067c-9644-4347-82d2-e271eae583d5 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:34.497265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bae067c-9644-4347-82d2-e271eae583d5 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:34.502930 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bae067c-9644-4347-82d2-e271eae583d5 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:34.504217 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bae067c-9644-4347-82d2-e271eae583d5 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:34.505029 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bae067c-9644-4347-82d2-e271eae583d5 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:34.505588 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6bae067c-9644-4347-82d2-e271eae583d5 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:34.615431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6bae067c-9644-4347-82d2-e271eae583d5 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:34.625250 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6bae067c-9644-4347-82d2-e271eae583d5 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1195 microversion: 2.1 time: 0.146331 Aug 18 11:05:34.626312 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 199/377] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:34 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1195 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:34.930076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-426683a7-b4ee-44c1-a476-f089bb2590f5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:34.930076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-426683a7-b4ee-44c1-a476-f089bb2590f5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:34.967031 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-426683a7-b4ee-44c1-a476-f089bb2590f5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:34.983981 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-426683a7-b4ee-44c1-a476-f089bb2590f5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:34.984724 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-426683a7-b4ee-44c1-a476-f089bb2590f5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:34.986188 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-426683a7-b4ee-44c1-a476-f089bb2590f5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:34.987510 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-426683a7-b4ee-44c1-a476-f089bb2590f5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:34.992359 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-426683a7-b4ee-44c1-a476-f089bb2590f5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:35.151354 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:35.151354 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:35.169021 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:35.169647 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:35.170162 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:35.170969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:35.171503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:35.172004 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:35.471303 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:35.497865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:35.503714 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:35.506044 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bad48f6f-4d2b-4f98-8733-37883afef0a5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.363177 Aug 18 11:05:35.509207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 200/378] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:35 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:35.578539 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-426683a7-b4ee-44c1-a476-f089bb2590f5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:35.609223 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-426683a7-b4ee-44c1-a476-f089bb2590f5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1365 microversion: 2.1 time: 0.685049 Aug 18 11:05:35.613775 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 179/379] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:34 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1365 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:35.662743 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5efbdb41-3310-4767-8735-f82613138e57 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:35.663409 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5efbdb41-3310-4767-8735-f82613138e57 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:35.687532 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5efbdb41-3310-4767-8735-f82613138e57 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:35.688132 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5efbdb41-3310-4767-8735-f82613138e57 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:35.688638 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5efbdb41-3310-4767-8735-f82613138e57 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:35.690025 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5efbdb41-3310-4767-8735-f82613138e57 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:35.690735 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5efbdb41-3310-4767-8735-f82613138e57 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:35.691362 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5efbdb41-3310-4767-8735-f82613138e57 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:35.811918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5efbdb41-3310-4767-8735-f82613138e57 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:35.827914 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5efbdb41-3310-4767-8735-f82613138e57 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1205 microversion: 2.1 time: 0.182325 Aug 18 11:05:35.832046 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 201/380] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:35 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1205 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:36.490070 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-0eeb1513-fd44-42be-8f36-c131212f6400 req-4d7e606b-f184-4d1b-b53c-4e3717e7430c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0e5602-14b6-4ab8-b7b7-0e383adf09be", "tag": "f139b73f-bdbe-4491-9b26-2e2bb5aa8136"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:36.500852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-0eeb1513-fd44-42be-8f36-c131212f6400 req-4d7e606b-f184-4d1b-b53c-4e3717e7430c service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:36.501344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-0eeb1513-fd44-42be-8f36-c131212f6400 req-4d7e606b-f184-4d1b-b53c-4e3717e7430c service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:36.501842 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-0eeb1513-fd44-42be-8f36-c131212f6400 req-4d7e606b-f184-4d1b-b53c-4e3717e7430c service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:36.531092 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:36.532338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:36.541097 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-0eeb1513-fd44-42be-8f36-c131212f6400 req-4d7e606b-f184-4d1b-b53c-4e3717e7430c service nova] Creating event network-changed:f139b73f-bdbe-4491-9b26-2e2bb5aa8136 for instance db0e5602-14b6-4ab8-b7b7-0e383adf09be on hv-cinder-82660 Aug 18 11:05:36.552488 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:36.553016 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:36.553464 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:36.554223 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:36.560140 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-0eeb1513-fd44-42be-8f36-c131212f6400 req-4d7e606b-f184-4d1b-b53c-4e3717e7430c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074700 Aug 18 11:05:36.562069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:36.562526 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:36.564534 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 180/381] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:05:36.635653 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3af960e6-73b0-49f7-94d6-39e5d0217d65 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:36.636568 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3af960e6-73b0-49f7-94d6-39e5d0217d65 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:36.653059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3af960e6-73b0-49f7-94d6-39e5d0217d65 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:36.655047 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3af960e6-73b0-49f7-94d6-39e5d0217d65 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:36.658590 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3af960e6-73b0-49f7-94d6-39e5d0217d65 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:36.661831 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3af960e6-73b0-49f7-94d6-39e5d0217d65 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:36.665103 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3af960e6-73b0-49f7-94d6-39e5d0217d65 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:36.666349 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3af960e6-73b0-49f7-94d6-39e5d0217d65 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:36.688683 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=100 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:37.055160 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:37.067616 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:37.070312 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:37.071829 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e71d43ce-e0c7-4cf6-a994-bbe995737d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.545707 Aug 18 11:05:37.072628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 202/382] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:36 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:05:37.077887 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-922971e2-01aa-4e4c-b077-67233891bf1b tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:37.078654 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-922971e2-01aa-4e4c-b077-67233891bf1b tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:37.086737 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-922971e2-01aa-4e4c-b077-67233891bf1b tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:37.087428 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-922971e2-01aa-4e4c-b077-67233891bf1b tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:37.088051 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-922971e2-01aa-4e4c-b077-67233891bf1b tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:37.088969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-922971e2-01aa-4e4c-b077-67233891bf1b tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:37.089604 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-922971e2-01aa-4e4c-b077-67233891bf1b tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:37.090484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-922971e2-01aa-4e4c-b077-67233891bf1b tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:37.385560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-922971e2-01aa-4e4c-b077-67233891bf1b tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:37.402359 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-922971e2-01aa-4e4c-b077-67233891bf1b tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.321570 Aug 18 11:05:37.406049 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 203/383] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:37 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:37.428996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3af960e6-73b0-49f7-94d6-39e5d0217d65 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:37.441811 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3af960e6-73b0-49f7-94d6-39e5d0217d65 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1554 microversion: 2.1 time: 0.806872 Aug 18 11:05:37.442578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 181/384] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:36 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1554 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:37.463413 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b4e71d91-955e-44ad-a132-f7f2d9cf7d7d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:37.464663 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b4e71d91-955e-44ad-a132-f7f2d9cf7d7d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:37.471960 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4e71d91-955e-44ad-a132-f7f2d9cf7d7d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:37.472713 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4e71d91-955e-44ad-a132-f7f2d9cf7d7d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:37.473307 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4e71d91-955e-44ad-a132-f7f2d9cf7d7d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:37.475122 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4e71d91-955e-44ad-a132-f7f2d9cf7d7d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:37.475915 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4e71d91-955e-44ad-a132-f7f2d9cf7d7d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:37.476632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4e71d91-955e-44ad-a132-f7f2d9cf7d7d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:37.618797 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b4e71d91-955e-44ad-a132-f7f2d9cf7d7d tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159267 Aug 18 11:05:37.627406 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 204/385] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Aug 18 11:05:37 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:05:38.098951 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:38.103488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:38.121281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:38.125667 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:38.126944 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:38.131602 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:38.138800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:38.141005 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:38.427881 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-64d1a250-ab21-449e-906d-c82f257f6134 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:38.428739 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-64d1a250-ab21-449e-906d-c82f257f6134 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:38.438797 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64d1a250-ab21-449e-906d-c82f257f6134 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:38.439738 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64d1a250-ab21-449e-906d-c82f257f6134 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:38.440574 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64d1a250-ab21-449e-906d-c82f257f6134 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:38.441396 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64d1a250-ab21-449e-906d-c82f257f6134 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:38.441981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64d1a250-ab21-449e-906d-c82f257f6134 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:38.442534 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64d1a250-ab21-449e-906d-c82f257f6134 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:38.573080 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:38.581905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:38.583761 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:38.585186 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-add8aad1-2b52-4f27-9725-517748ec5e5c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.490774 Aug 18 11:05:38.585843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 182/386] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:38 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:38.595241 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-64d1a250-ab21-449e-906d-c82f257f6134 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:38.604917 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-64d1a250-ab21-449e-906d-c82f257f6134 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.181642 Aug 18 11:05:38.605790 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 205/387] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:38 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:39.206949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-4933a44f-9a77-4776-bfe8-5ca9824a989b req-030a6b9f-2f91-4a19-ba29-b0fdcdf73a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f24c60c-50af-4a18-bd0a-20de259bc3c8", "tag": "38d8f7be-04b7-4a8b-ab84-70a8f2444464"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:39.216921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4933a44f-9a77-4776-bfe8-5ca9824a989b req-030a6b9f-2f91-4a19-ba29-b0fdcdf73a57 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:39.217406 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4933a44f-9a77-4776-bfe8-5ca9824a989b req-030a6b9f-2f91-4a19-ba29-b0fdcdf73a57 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:39.217882 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4933a44f-9a77-4776-bfe8-5ca9824a989b req-030a6b9f-2f91-4a19-ba29-b0fdcdf73a57 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:39.230910 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-4933a44f-9a77-4776-bfe8-5ca9824a989b req-030a6b9f-2f91-4a19-ba29-b0fdcdf73a57 service nova] Creating event network-changed:38d8f7be-04b7-4a8b-ab84-70a8f2444464 for instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 on hv-cinder-82660 Aug 18 11:05:39.236023 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-4933a44f-9a77-4776-bfe8-5ca9824a989b req-030a6b9f-2f91-4a19-ba29-b0fdcdf73a57 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033613 Aug 18 11:05:39.237035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 183/388] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:05:39.610030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:39.610633 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:39.617631 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:39.618115 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:39.618547 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:39.619239 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:39.619689 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:39.621651 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:39.627660 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-46a573cf-6f24-491a-b254-3eae8f14235c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:39.628796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-46a573cf-6f24-491a-b254-3eae8f14235c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:39.635164 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-46a573cf-6f24-491a-b254-3eae8f14235c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:39.635737 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-46a573cf-6f24-491a-b254-3eae8f14235c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:39.636244 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-46a573cf-6f24-491a-b254-3eae8f14235c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:39.637016 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-46a573cf-6f24-491a-b254-3eae8f14235c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:39.637796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-46a573cf-6f24-491a-b254-3eae8f14235c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:39.638313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-46a573cf-6f24-491a-b254-3eae8f14235c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:39.768468 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:39.777391 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:39.779035 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:39.780202 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ee19a665-ca5d-4253-955a-cfc7f635ea78 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.174164 Aug 18 11:05:39.781256 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 206/389] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:39 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:39.782330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-46a573cf-6f24-491a-b254-3eae8f14235c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:39.790687 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-46a573cf-6f24-491a-b254-3eae8f14235c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.167421 Aug 18 11:05:39.801756 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 184/390] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:39 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:40.816203 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:40.816916 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:40.818921 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-00287cf3-87c4-4ff5-9aa9-28286830e6eb tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:40.819988 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-00287cf3-87c4-4ff5-9aa9-28286830e6eb tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:40.835254 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-00287cf3-87c4-4ff5-9aa9-28286830e6eb tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:40.841043 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:40.843905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-00287cf3-87c4-4ff5-9aa9-28286830e6eb tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:40.844358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-00287cf3-87c4-4ff5-9aa9-28286830e6eb tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:40.845187 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-00287cf3-87c4-4ff5-9aa9-28286830e6eb tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:40.846123 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-00287cf3-87c4-4ff5-9aa9-28286830e6eb tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:40.846788 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-00287cf3-87c4-4ff5-9aa9-28286830e6eb tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:40.850349 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:40.851612 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:40.852700 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:40.853390 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:40.854079 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:41.061638 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-00287cf3-87c4-4ff5-9aa9-28286830e6eb tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:41.071153 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-00287cf3-87c4-4ff5-9aa9-28286830e6eb tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.263110 Aug 18 11:05:41.071772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 207/391] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:40 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:41.115323 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:41.133341 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:41.135084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:41.136254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9f0c3f28-872e-4a55-83d5-70dafe498143 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.324752 Aug 18 11:05:41.141711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 185/392] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:40 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:41.379838 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-e8a7c3fc-3554-4edd-b5c0-227dd8075696 req-eacc0136-e7f7-4e21-93f8-4ebe26fcdc1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192f88e2-9697-4492-ac5f-83e871070136", "tag": "8f8c3d63-26c6-4e2b-9922-666ae0de919b"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:41.393005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-e8a7c3fc-3554-4edd-b5c0-227dd8075696 req-eacc0136-e7f7-4e21-93f8-4ebe26fcdc1d service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:41.393488 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-e8a7c3fc-3554-4edd-b5c0-227dd8075696 req-eacc0136-e7f7-4e21-93f8-4ebe26fcdc1d service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:41.393935 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-e8a7c3fc-3554-4edd-b5c0-227dd8075696 req-eacc0136-e7f7-4e21-93f8-4ebe26fcdc1d service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:41.410768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-e8a7c3fc-3554-4edd-b5c0-227dd8075696 req-eacc0136-e7f7-4e21-93f8-4ebe26fcdc1d service nova] Creating event network-changed:8f8c3d63-26c6-4e2b-9922-666ae0de919b for instance 192f88e2-9697-4492-ac5f-83e871070136 on hv-cinder-82660 Aug 18 11:05:41.416764 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-e8a7c3fc-3554-4edd-b5c0-227dd8075696 req-eacc0136-e7f7-4e21-93f8-4ebe26fcdc1d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042867 Aug 18 11:05:41.417903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 208/393] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:05:42.097019 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c70912b9-9774-4526-a156-1117773d4f70 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:42.097680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c70912b9-9774-4526-a156-1117773d4f70 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:42.099659 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:42.106466 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c70912b9-9774-4526-a156-1117773d4f70 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:42.107254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c70912b9-9774-4526-a156-1117773d4f70 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:42.108535 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c70912b9-9774-4526-a156-1117773d4f70 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:42.109466 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c70912b9-9774-4526-a156-1117773d4f70 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:42.110346 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c70912b9-9774-4526-a156-1117773d4f70 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:42.111730 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c70912b9-9774-4526-a156-1117773d4f70 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:42.160919 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:42.162628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:42.170989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:42.171698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:42.176523 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:42.182768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:42.183363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:42.183878 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:42.195477 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=8 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:42.333048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c70912b9-9774-4526-a156-1117773d4f70 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:42.346400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c70912b9-9774-4526-a156-1117773d4f70 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.253817 Aug 18 11:05:42.357963 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 186/394] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:42 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:42.429288 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:42.438706 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:42.440648 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:42.442227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b0edd348-a1c1-4d75-9bc3-53c493609d76 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.286648 Aug 18 11:05:42.443276 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 209/395] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:42 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:05:43.378792 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a52c2455-8dc6-44bc-9ec9-dba2a02d416c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:43.379596 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a52c2455-8dc6-44bc-9ec9-dba2a02d416c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:43.392507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a52c2455-8dc6-44bc-9ec9-dba2a02d416c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:43.393009 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a52c2455-8dc6-44bc-9ec9-dba2a02d416c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:43.393448 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a52c2455-8dc6-44bc-9ec9-dba2a02d416c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:43.394178 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a52c2455-8dc6-44bc-9ec9-dba2a02d416c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:43.394630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a52c2455-8dc6-44bc-9ec9-dba2a02d416c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:43.395083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a52c2455-8dc6-44bc-9ec9-dba2a02d416c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:43.470565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:43.471730 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:43.482414 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:43.483074 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:43.483657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:43.484531 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:43.485135 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:43.485759 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:43.661873 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:43.670851 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:43.672353 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:43.674080 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-53cfdcd8-f69f-40d9-9bad-8a03d63ebeb6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.206955 Aug 18 11:05:43.684437 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 210/396] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:43 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:43.733208 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a52c2455-8dc6-44bc-9ec9-dba2a02d416c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:43.742432 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a52c2455-8dc6-44bc-9ec9-dba2a02d416c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.369934 Aug 18 11:05:43.743341 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 187/397] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:43 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:44.711654 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:44.712549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:44.730388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:44.732474 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:44.733150 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:44.734456 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:44.739386 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:44.742306 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:44.767026 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fbd6ab85-9b2b-4e0f-815c-a1507bd4a201 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:44.767966 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fbd6ab85-9b2b-4e0f-815c-a1507bd4a201 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:44.789698 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbd6ab85-9b2b-4e0f-815c-a1507bd4a201 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:44.790649 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbd6ab85-9b2b-4e0f-815c-a1507bd4a201 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:44.791548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbd6ab85-9b2b-4e0f-815c-a1507bd4a201 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:44.792629 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbd6ab85-9b2b-4e0f-815c-a1507bd4a201 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:44.794807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbd6ab85-9b2b-4e0f-815c-a1507bd4a201 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:44.795592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbd6ab85-9b2b-4e0f-815c-a1507bd4a201 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:45.011023 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:45.019125 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fbd6ab85-9b2b-4e0f-815c-a1507bd4a201 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:45.022245 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:45.025557 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:45.027182 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1b527eb6-3059-4a8c-bc94-6ea197cb0ac3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.319566 Aug 18 11:05:45.029871 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 211/398] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:44 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:45.031520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fbd6ab85-9b2b-4e0f-815c-a1507bd4a201 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.269275 Aug 18 11:05:45.034281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 188/399] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:44 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:46.063574 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-88f11c34-5dcb-427b-b644-a66bb17977d4 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:46.066503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-88f11c34-5dcb-427b-b644-a66bb17977d4 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:46.066981 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:46.068213 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:46.072181 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:46.075938 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88f11c34-5dcb-427b-b644-a66bb17977d4 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:46.076455 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88f11c34-5dcb-427b-b644-a66bb17977d4 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:46.076942 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88f11c34-5dcb-427b-b644-a66bb17977d4 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:46.078984 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:46.079271 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88f11c34-5dcb-427b-b644-a66bb17977d4 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:46.079664 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:46.080736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:46.081297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88f11c34-5dcb-427b-b644-a66bb17977d4 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:46.081423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:46.081926 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:46.082230 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88f11c34-5dcb-427b-b644-a66bb17977d4 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:46.082358 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:46.260244 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:46.275138 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:46.279402 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:46.284233 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-aadeae9e-b2eb-4c06-8d10-b7d9e3b843bb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.222047 Aug 18 11:05:46.285492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 189/400] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:46 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:05:46.299787 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-88f11c34-5dcb-427b-b644-a66bb17977d4 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:46.316823 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-88f11c34-5dcb-427b-b644-a66bb17977d4 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.258335 Aug 18 11:05:46.318224 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 212/401] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:46 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:47.311179 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:47.311782 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:47.318145 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:47.318623 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:47.319053 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:47.319744 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:47.320191 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:47.320614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:47.344352 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bc940a37-75a7-4aec-8fb1-0e04bc2c8148 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:47.344352 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bc940a37-75a7-4aec-8fb1-0e04bc2c8148 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:47.346802 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc940a37-75a7-4aec-8fb1-0e04bc2c8148 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:47.347289 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc940a37-75a7-4aec-8fb1-0e04bc2c8148 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:47.347861 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc940a37-75a7-4aec-8fb1-0e04bc2c8148 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:47.348572 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc940a37-75a7-4aec-8fb1-0e04bc2c8148 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:47.349024 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc940a37-75a7-4aec-8fb1-0e04bc2c8148 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:47.349459 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc940a37-75a7-4aec-8fb1-0e04bc2c8148 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:47.461285 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:47.469295 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:47.471499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:47.472692 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5cc79b5c-f725-4d11-980d-3eab3f62c80c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.165413 Aug 18 11:05:47.473256 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 190/402] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:47 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:47.493333 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bc940a37-75a7-4aec-8fb1-0e04bc2c8148 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:47.502951 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bc940a37-75a7-4aec-8fb1-0e04bc2c8148 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.167987 Aug 18 11:05:47.503745 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 213/403] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:47 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:48.495582 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:48.496218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:48.502858 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:48.503390 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:48.503833 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:48.504540 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:48.504995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:48.505436 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:48.528084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2f642157-03b8-4f3b-9a75-ef710f8ac609 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:48.530324 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2f642157-03b8-4f3b-9a75-ef710f8ac609 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:48.543220 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2f642157-03b8-4f3b-9a75-ef710f8ac609 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:48.544077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2f642157-03b8-4f3b-9a75-ef710f8ac609 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:48.545656 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2f642157-03b8-4f3b-9a75-ef710f8ac609 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:48.547311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2f642157-03b8-4f3b-9a75-ef710f8ac609 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:48.548066 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2f642157-03b8-4f3b-9a75-ef710f8ac609 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:48.549272 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2f642157-03b8-4f3b-9a75-ef710f8ac609 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:48.659448 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:48.669109 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:48.671176 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:48.672552 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-01a2c1f3-f0aa-4d7e-992d-8ca8922dc787 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.180832 Aug 18 11:05:48.673148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 191/404] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:48 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:48.702602 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2f642157-03b8-4f3b-9a75-ef710f8ac609 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:48.711717 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2f642157-03b8-4f3b-9a75-ef710f8ac609 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.191688 Aug 18 11:05:48.712302 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 214/405] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:48 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:49.695829 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:49.697196 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:49.704955 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:49.705453 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:49.706124 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:49.707169 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:49.707631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:49.708059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:49.733002 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0eb96411-5189-451d-8854-b0647a709e66 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:49.733708 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0eb96411-5189-451d-8854-b0647a709e66 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:49.743445 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0eb96411-5189-451d-8854-b0647a709e66 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:49.743866 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0eb96411-5189-451d-8854-b0647a709e66 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:49.744332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0eb96411-5189-451d-8854-b0647a709e66 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:49.745233 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0eb96411-5189-451d-8854-b0647a709e66 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:49.745936 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0eb96411-5189-451d-8854-b0647a709e66 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:49.746367 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0eb96411-5189-451d-8854-b0647a709e66 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:49.889743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:49.903869 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:49.905875 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:49.908806 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c5fc578c-d6ec-4269-ac87-89c2c8873824 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.215804 Aug 18 11:05:49.910421 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 192/406] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:49 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:49.918704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0eb96411-5189-451d-8854-b0647a709e66 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:49.926599 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=100 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:49.932697 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0eb96411-5189-451d-8854-b0647a709e66 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.203574 Aug 18 11:05:49.933407 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 215/407] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:49 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:50.932773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:50.934132 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:50.944694 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:50.945240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:50.946100 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:50.946938 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:50.947399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:50.948277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:50.954553 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b9f962bc-cd86-4982-91ec-601a39090e19 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:50.955481 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b9f962bc-cd86-4982-91ec-601a39090e19 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:50.958003 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:50.967034 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b9f962bc-cd86-4982-91ec-601a39090e19 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:50.967530 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b9f962bc-cd86-4982-91ec-601a39090e19 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:50.969151 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b9f962bc-cd86-4982-91ec-601a39090e19 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:50.969892 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b9f962bc-cd86-4982-91ec-601a39090e19 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:50.970382 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b9f962bc-cd86-4982-91ec-601a39090e19 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:50.970813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b9f962bc-cd86-4982-91ec-601a39090e19 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:51.099526 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:51.108878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:51.110468 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:51.112475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2b975431-5196-43d7-9f44-1bc8ec3a0c30 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.184035 Aug 18 11:05:51.113016 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 193/408] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:50 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:51.174926 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b9f962bc-cd86-4982-91ec-601a39090e19 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:51.183001 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b9f962bc-cd86-4982-91ec-601a39090e19 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.232343 Aug 18 11:05:51.183572 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 216/409] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:50 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:52.049482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-4e1f28f7-54f7-4418-ac45-9472492d4335 req-9fbb4e95-1ab2-43a7-b12e-e5847743e0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192f88e2-9697-4492-ac5f-83e871070136", "name": "network-vif-plugged", "status": "completed", "tag": "8f8c3d63-26c6-4e2b-9922-666ae0de919b"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:52.065612 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4e1f28f7-54f7-4418-ac45-9472492d4335 req-9fbb4e95-1ab2-43a7-b12e-e5847743e0b4 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:52.066105 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4e1f28f7-54f7-4418-ac45-9472492d4335 req-9fbb4e95-1ab2-43a7-b12e-e5847743e0b4 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:52.066550 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4e1f28f7-54f7-4418-ac45-9472492d4335 req-9fbb4e95-1ab2-43a7-b12e-e5847743e0b4 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:52.081065 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-4e1f28f7-54f7-4418-ac45-9472492d4335 req-9fbb4e95-1ab2-43a7-b12e-e5847743e0b4 service nova] Creating event network-vif-plugged:8f8c3d63-26c6-4e2b-9922-666ae0de919b for instance 192f88e2-9697-4492-ac5f-83e871070136 on hv-cinder-82660 Aug 18 11:05:52.088370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-4e1f28f7-54f7-4418-ac45-9472492d4335 req-9fbb4e95-1ab2-43a7-b12e-e5847743e0b4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043097 Aug 18 11:05:52.088992 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 194/410] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:05:52.139491 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:52.140107 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:52.151614 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:52.152253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:52.152700 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:52.153929 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:52.154606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:52.155043 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:52.207472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1e433483-acb0-4041-8b78-475ebf7ef38d tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:52.207472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1e433483-acb0-4041-8b78-475ebf7ef38d tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:52.214218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e433483-acb0-4041-8b78-475ebf7ef38d tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:52.214802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e433483-acb0-4041-8b78-475ebf7ef38d tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:52.215323 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e433483-acb0-4041-8b78-475ebf7ef38d tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:52.216035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e433483-acb0-4041-8b78-475ebf7ef38d tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:52.216603 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e433483-acb0-4041-8b78-475ebf7ef38d tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:52.217036 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e433483-acb0-4041-8b78-475ebf7ef38d tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:52.339013 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:52.348263 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:52.349857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:52.351036 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bdec4ef8-c287-45a6-b429-002baa22a311 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.216901 Aug 18 11:05:52.351773 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 217/411] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:52 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:05:52.429267 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1e433483-acb0-4041-8b78-475ebf7ef38d tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:52.437084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1e433483-acb0-4041-8b78-475ebf7ef38d tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.235766 Aug 18 11:05:52.437725 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 195/412] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:52 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:53.376284 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:53.378132 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:53.385581 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:53.386076 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:53.386514 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:53.387221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:53.387802 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:53.388233 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:53.458786 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-21878df7-a4aa-452a-a502-9a2d24b99280 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:53.459490 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-21878df7-a4aa-452a-a502-9a2d24b99280 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:53.466082 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21878df7-a4aa-452a-a502-9a2d24b99280 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:53.466680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21878df7-a4aa-452a-a502-9a2d24b99280 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:53.467189 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21878df7-a4aa-452a-a502-9a2d24b99280 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:53.467958 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21878df7-a4aa-452a-a502-9a2d24b99280 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:53.468552 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21878df7-a4aa-452a-a502-9a2d24b99280 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:53.469050 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21878df7-a4aa-452a-a502-9a2d24b99280 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:53.590077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:53.600242 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:53.602436 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:53.603645 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-82a12eb6-9148-4ddb-ad02-efd3aff2429a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.231290 Aug 18 11:05:53.613948 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 218/413] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:53 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:53.625550 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-21878df7-a4aa-452a-a502-9a2d24b99280 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:53.633800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-21878df7-a4aa-452a-a502-9a2d24b99280 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1261 microversion: 2.1 time: 0.179412 Aug 18 11:05:53.634625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 196/414] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:53 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:54.628996 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:54.629750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:54.636090 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:54.636648 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:54.637171 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:54.637959 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:54.638490 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:54.638965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:54.655224 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9ebf45c3-23c5-4452-8f95-bdbbbe83ab1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:54.656148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9ebf45c3-23c5-4452-8f95-bdbbbe83ab1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:54.663046 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ebf45c3-23c5-4452-8f95-bdbbbe83ab1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:54.663586 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ebf45c3-23c5-4452-8f95-bdbbbe83ab1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:54.664030 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ebf45c3-23c5-4452-8f95-bdbbbe83ab1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:54.664792 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ebf45c3-23c5-4452-8f95-bdbbbe83ab1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:54.665251 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ebf45c3-23c5-4452-8f95-bdbbbe83ab1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:54.665702 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9ebf45c3-23c5-4452-8f95-bdbbbe83ab1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:54.787788 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:54.797057 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:54.799794 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:54.800644 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0d65b798-db3b-4cdf-b51c-07f0b770526a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1745 microversion: 2.20 time: 0.176284 Aug 18 11:05:54.801730 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 219/415] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:54 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:05:54.822007 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9ebf45c3-23c5-4452-8f95-bdbbbe83ab1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:54.830167 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9ebf45c3-23c5-4452-8f95-bdbbbe83ab1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1444 microversion: 2.1 time: 0.178400 Aug 18 11:05:54.831176 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 197/416] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:54 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1444 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:05:54.851689 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-44619cc7-29ad-4342-a3f2-0737166a8bf8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:54.852451 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-44619cc7-29ad-4342-a3f2-0737166a8bf8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:54.858561 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-44619cc7-29ad-4342-a3f2-0737166a8bf8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:54.859173 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-44619cc7-29ad-4342-a3f2-0737166a8bf8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:54.859777 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-44619cc7-29ad-4342-a3f2-0737166a8bf8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:54.860473 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-44619cc7-29ad-4342-a3f2-0737166a8bf8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:54.861461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-44619cc7-29ad-4342-a3f2-0737166a8bf8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:54.861910 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-44619cc7-29ad-4342-a3f2-0737166a8bf8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:55.004700 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-44619cc7-29ad-4342-a3f2-0737166a8bf8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:55.012365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-44619cc7-29ad-4342-a3f2-0737166a8bf8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1444 microversion: 2.1 time: 0.164402 Aug 18 11:05:55.013222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 220/417] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:05:54 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:05:55.825766 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:55.826441 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:55.833837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:55.834344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:55.834995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:55.835685 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:55.836133 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:55.836552 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:55.978534 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:55.987172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:55.988969 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:55.991116 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a61ef9c5-b3b0-459d-88df-5f0dcc23099e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1745 microversion: 2.20 time: 0.169236 Aug 18 11:05:55.992035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 198/418] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:55 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:56.921590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-2dae3531-b345-4a89-a696-4a0a4f0f21d3 req-bd6cd25f-a987-43f5-86d2-b325c04b852d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192f88e2-9697-4492-ac5f-83e871070136", "tag": "8f8c3d63-26c6-4e2b-9922-666ae0de919b"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:56.932097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-2dae3531-b345-4a89-a696-4a0a4f0f21d3 req-bd6cd25f-a987-43f5-86d2-b325c04b852d service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:56.932635 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-2dae3531-b345-4a89-a696-4a0a4f0f21d3 req-bd6cd25f-a987-43f5-86d2-b325c04b852d service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:56.933089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-2dae3531-b345-4a89-a696-4a0a4f0f21d3 req-bd6cd25f-a987-43f5-86d2-b325c04b852d service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:56.945713 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-2dae3531-b345-4a89-a696-4a0a4f0f21d3 req-bd6cd25f-a987-43f5-86d2-b325c04b852d service nova] Creating event network-changed:8f8c3d63-26c6-4e2b-9922-666ae0de919b for instance 192f88e2-9697-4492-ac5f-83e871070136 on hv-cinder-82660 Aug 18 11:05:56.950903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-2dae3531-b345-4a89-a696-4a0a4f0f21d3 req-bd6cd25f-a987-43f5-86d2-b325c04b852d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033442 Aug 18 11:05:56.951560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 221/419] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:05:57.014981 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:57.016442 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:57.024416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:57.024953 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:57.025583 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:57.026320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:57.026781 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:57.027218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:57.031624 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=100 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:05:57.271310 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:57.282344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:57.287669 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:57.289194 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d7b7ae86-2c98-44cb-b7bf-236d3d208b03 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1745 microversion: 2.20 time: 0.278336 Aug 18 11:05:57.290241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 199/420] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:57 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1745 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:58.274450 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-335c8e14-c0b2-41e0-a8b2-7f88413fa86e req-d8565506-2455-4dc1-a04a-9463c45fbff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e210ba46-e81e-4939-b202-4b569f906d8b", "name": "network-vif-plugged", "status": "completed", "tag": "850023d2-3a9f-4c57-85af-2b31e7f7b114"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:05:58.288884 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-335c8e14-c0b2-41e0-a8b2-7f88413fa86e req-d8565506-2455-4dc1-a04a-9463c45fbff2 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:58.289380 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-335c8e14-c0b2-41e0-a8b2-7f88413fa86e req-d8565506-2455-4dc1-a04a-9463c45fbff2 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:58.289845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-335c8e14-c0b2-41e0-a8b2-7f88413fa86e req-d8565506-2455-4dc1-a04a-9463c45fbff2 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:58.316746 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-335c8e14-c0b2-41e0-a8b2-7f88413fa86e req-d8565506-2455-4dc1-a04a-9463c45fbff2 service nova] Creating event network-vif-plugged:850023d2-3a9f-4c57-85af-2b31e7f7b114 for instance e210ba46-e81e-4939-b202-4b569f906d8b on hv-cinder-82660 Aug 18 11:05:58.322480 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-335c8e14-c0b2-41e0-a8b2-7f88413fa86e req-d8565506-2455-4dc1-a04a-9463c45fbff2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052959 Aug 18 11:05:58.323665 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 222/421] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:05:58.324179 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:58.325442 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:58.362900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:58.363410 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:58.364973 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:58.366009 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:58.366659 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:58.367244 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:58.553282 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:58.568678 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:58.570919 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:58.572637 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-640d935b-dc14-43a8-bd79-cc78ad8f37ae tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1740 microversion: 2.20 time: 0.257066 Aug 18 11:05:58.586035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 200/422] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:58 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:05:59.598640 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:05:59.599992 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:05:59.606363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:59.607141 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:59.608047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:59.609038 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:05:59.609599 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:05:59.610066 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:05:59.756570 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:59.770771 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:59.772294 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:05:59.773461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8135a76c-0f09-49c0-b35d-7bca0728e957 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1740 microversion: 2.20 time: 0.180292 Aug 18 11:05:59.774045 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 223/423] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:05:59 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:00.800864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:00.801490 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:00.808304 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:00.808864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:00.809344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:00.810241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:00.810701 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:00.811212 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:00.970947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:00.980030 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:00.981652 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:00.982869 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0707d8fc-3bca-436d-8c7a-422284028c5f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1740 microversion: 2.20 time: 0.186962 Aug 18 11:06:00.983462 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 201/424] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:00 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:02.017910 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:02.018901 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:02.028092 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:02.028697 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:02.029332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:02.030137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:02.030874 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:02.031311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:02.199221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:02.210077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:02.211594 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:02.212769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-05e501ad-75d2-41eb-80eb-c8b09046657c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1740 microversion: 2.20 time: 0.203492 Aug 18 11:06:02.213325 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 224/425] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:02 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:03.240059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:03.240753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:03.247754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:03.248256 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:03.248699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:03.249414 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:03.249894 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:03.250324 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:03.402413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:03.410762 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:03.412535 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:03.414153 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7bf038e5-d7e0-4539-bedf-e8cceb00b4d2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1740 microversion: 2.20 time: 0.178751 Aug 18 11:06:03.414964 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 202/426] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:03 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:04.443476 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:04.444157 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:04.451521 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:04.452030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:04.452460 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:04.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:04.453704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:04.454547 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:04.604868 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:04.616726 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:04.618244 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:04.619405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3212e94d-72db-42c4-a6ce-d81e4fcf3ba4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1740 microversion: 2.20 time: 0.181385 Aug 18 11:06:04.619956 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 225/427] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:04 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:05.647322 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:05.648003 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:05.654943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:05.655427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:05.655857 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:05.656547 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:05.656995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:05.657956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:05.821111 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:05.830854 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:05.832352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:05.833510 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-79fbbf69-325d-4092-ade5-3fa2998e52a1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1740 microversion: 2.20 time: 0.194454 Aug 18 11:06:05.841573 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 203/428] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:05 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:06.858877 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:06.859528 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:06.867503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:06.867983 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:06.868441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:06.869195 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:06.872391 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:06.872849 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:07.021263 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:07.029273 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:07.030838 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:07.031985 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4aba5403-b5d7-4c3c-ac85-b1f95aee90ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1740 microversion: 2.20 time: 0.177035 Aug 18 11:06:07.033085 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 226/429] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:06 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:08.055766 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:08.056357 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:08.062853 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:08.063334 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:08.064458 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:08.065371 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:08.065860 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:08.066290 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:08.204879 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:08.212925 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:08.214458 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:08.215623 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-66708be0-fdfe-404b-8bb4-218c336b1965 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1722 microversion: 2.20 time: 0.164121 Aug 18 11:06:08.216440 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 204/430] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:08 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:09.238507 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:09.239122 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:09.245537 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:09.246024 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:09.246457 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:09.247144 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:09.247599 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:09.248019 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:09.384789 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:09.393947 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:09.395465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:09.396623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-28094535-60dd-4f16-bded-894ac3de4e36 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1722 microversion: 2.20 time: 0.162074 Aug 18 11:06:09.397185 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 227/431] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:09 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:10.075096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-ffbf78b2-e2fb-49d2-b946-2e051c8e1e0b req-80ff5122-09d6-403c-aebb-33deebcfb2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e210ba46-e81e-4939-b202-4b569f906d8b", "name": "network-vif-unplugged", "status": "completed", "tag": "850023d2-3a9f-4c57-85af-2b31e7f7b114"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:10.086126 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-ffbf78b2-e2fb-49d2-b946-2e051c8e1e0b req-80ff5122-09d6-403c-aebb-33deebcfb2c1 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:10.086620 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-ffbf78b2-e2fb-49d2-b946-2e051c8e1e0b req-80ff5122-09d6-403c-aebb-33deebcfb2c1 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:10.087125 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-ffbf78b2-e2fb-49d2-b946-2e051c8e1e0b req-80ff5122-09d6-403c-aebb-33deebcfb2c1 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:10.101408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-ffbf78b2-e2fb-49d2-b946-2e051c8e1e0b req-80ff5122-09d6-403c-aebb-33deebcfb2c1 service nova] Creating event network-vif-unplugged:850023d2-3a9f-4c57-85af-2b31e7f7b114 for instance e210ba46-e81e-4939-b202-4b569f906d8b on hv-cinder-82660 Aug 18 11:06:10.106434 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-ffbf78b2-e2fb-49d2-b946-2e051c8e1e0b req-80ff5122-09d6-403c-aebb-33deebcfb2c1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035094 Aug 18 11:06:10.107029 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 205/432] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:10.420456 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:10.421171 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:10.427364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:10.427842 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:10.428269 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:10.428959 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:10.429404 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:10.429857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:10.573260 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:10.582062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:10.583570 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:10.584718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-04dfdd5a-abd4-4f55-aaec-ad6f7f2f08ad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1665 microversion: 2.20 time: 0.168497 Aug 18 11:06:10.585283 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 228/433] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:10 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1665 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:10.608368 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e7c45c48-eae0-4481-8e95-35c354ac0b07 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11bac33a-ddd1-4664-8dc1-d3186f38e4ca"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:10.611515 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e7c45c48-eae0-4481-8e95-35c354ac0b07 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:10.618106 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7c45c48-eae0-4481-8e95-35c354ac0b07 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:10.618589 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7c45c48-eae0-4481-8e95-35c354ac0b07 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:10.619025 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7c45c48-eae0-4481-8e95-35c354ac0b07 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:10.619721 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7c45c48-eae0-4481-8e95-35c354ac0b07 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:10.620167 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7c45c48-eae0-4481-8e95-35c354ac0b07 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:10.620583 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7c45c48-eae0-4481-8e95-35c354ac0b07 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:10.910840 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e7c45c48-eae0-4481-8e95-35c354ac0b07 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "POST /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307038 Aug 18 11:06:10.911502 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 206/434] 10.222.0.15 () {62 vars in 1364 bytes} [Thu Aug 18 11:06:10 2022] POST /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:06:11.036047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-84b05a39-afa5-4674-8bf8-570ae6b7be00 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:11.036646 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-84b05a39-afa5-4674-8bf8-570ae6b7be00 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:11.043165 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-84b05a39-afa5-4674-8bf8-570ae6b7be00 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:11.043772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-84b05a39-afa5-4674-8bf8-570ae6b7be00 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:11.044210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-84b05a39-afa5-4674-8bf8-570ae6b7be00 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:11.044901 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-84b05a39-afa5-4674-8bf8-570ae6b7be00 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:11.045358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-84b05a39-afa5-4674-8bf8-570ae6b7be00 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:11.045818 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-84b05a39-afa5-4674-8bf8-570ae6b7be00 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:11.090579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-84b05a39-afa5-4674-8bf8-570ae6b7be00 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120800) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 11:06:11.160592 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-84b05a39-afa5-4674-8bf8-570ae6b7be00 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "POST /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/action" status: 202 len: 0 microversion: 2.20 time: 0.129542 Aug 18 11:06:11.161200 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 229/435] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Aug 18 11:06:11 2022] POST /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:06:11.169805 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:11.170445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:11.178633 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:11.179127 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:11.179561 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:11.180256 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:11.180706 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:11.181134 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:11.332930 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:11.347939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:11.350584 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:11.352500 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4870694a-ac30-46c3-8336-0d9fec7d030f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1751 microversion: 2.20 time: 0.186711 Aug 18 11:06:11.353431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 207/436] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:11 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:12.393554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:12.394232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:12.400279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:12.400766 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:12.401201 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:12.401942 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:12.402381 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:12.402803 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:12.540335 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:12.549845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:12.551360 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:12.552526 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2e04c6cd-686c-4af1-858e-158ac4b5b120 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1753 microversion: 2.20 time: 0.164254 Aug 18 11:06:12.553122 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 230/437] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:12 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:13.576453 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:13.577059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:13.585578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:13.586157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:13.586604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:13.587315 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:13.587770 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:13.588197 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:14.022875 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:14.032423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:14.033840 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:14.035005 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b2333024-cb75-43bd-8342-352b47c75799 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.462461 Aug 18 11:06:14.035566 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 208/438] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:13 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:15.060919 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:15.062361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:15.070587 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:15.071077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:15.071514 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:15.072219 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:15.072683 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:15.073136 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:15.232609 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:15.243258 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:15.244982 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:15.246316 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-92553b04-9679-417c-9bcd-240cfc684c34 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.190872 Aug 18 11:06:15.247086 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 231/439] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:15 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:16.244449 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:06:16.245478 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Thu Aug 18 11:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:06:16.270488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:16.271218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:16.273694 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=40 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:16.279910 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:16.280492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:16.280929 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:16.281770 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:16.282421 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:16.282849 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:16.425807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:16.436582 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:16.438162 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:16.439938 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-11438871-e800-44fc-939f-11abe02e54f8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.174369 Aug 18 11:06:16.440618 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 209/440] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:16 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:17.464313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:17.465768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:17.474777 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:17.475405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:17.475915 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:17.476701 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:17.477232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:17.477739 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:17.625212 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:17.629923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:17.636174 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:17.637705 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:17.639079 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2413eb22-78e2-4e3a-a466-cd8721cd731f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.178585 Aug 18 11:06:17.639643 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 232/441] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:17 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:18.666172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:18.667021 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:18.674754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:18.675457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:18.675992 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:18.676785 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:18.677235 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:18.677685 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:18.822614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:18.832228 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:18.833790 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:18.834944 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3db2dff2-4dce-47ed-9e91-cc36fdb0390f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.172838 Aug 18 11:06:18.835500 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 210/442] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:18 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:19.861168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:19.862009 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:19.869533 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:19.870032 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:19.870468 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:19.871171 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:19.871625 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:19.872050 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:20.016134 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:20.025572 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:20.027074 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:20.028266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-559aad8a-2466-447e-97b2-e161cf28f911 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.172683 Aug 18 11:06:20.028823 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 233/443] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:19 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:06:21.053240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:21.053971 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:21.060326 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:21.060805 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:21.061239 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:21.061956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:21.062408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:21.062828 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:21.208846 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:21.220980 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:21.226475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:21.228160 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ed7a51d7-056f-49e2-b0b6-71222328dbaa tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.178707 Aug 18 11:06:21.228925 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 211/444] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:21 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:22.215086 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bc6c8dad-3c1e-40a7-9fdd-db3e7307e3a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c14118f4-7874-4a55-ad1c-f842c7466ec4"}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:22.217631 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bc6c8dad-3c1e-40a7-9fdd-db3e7307e3a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:22.220122 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:22.225740 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc6c8dad-3c1e-40a7-9fdd-db3e7307e3a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:22.226425 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc6c8dad-3c1e-40a7-9fdd-db3e7307e3a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:22.227233 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc6c8dad-3c1e-40a7-9fdd-db3e7307e3a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:22.228408 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc6c8dad-3c1e-40a7-9fdd-db3e7307e3a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:22.228860 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc6c8dad-3c1e-40a7-9fdd-db3e7307e3a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:22.229368 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc6c8dad-3c1e-40a7-9fdd-db3e7307e3a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:22.253581 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:22.254516 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:22.268687 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:22.269066 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:22.269509 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:22.270232 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:22.270713 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:22.271323 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:22.416770 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:22.425872 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:22.427361 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:22.428506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1d8b3385-9276-482e-b7be-fb6014d9afc4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.180166 Aug 18 11:06:22.429052 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 212/445] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:22 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:23.452709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:23.453371 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:23.460493 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:23.461141 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:23.461609 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:23.462404 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:23.462862 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:23.463565 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:23.610067 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:23.614631 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:23.628843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:23.630531 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:23.631809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-866b627a-398c-4333-8f60-15b2998737ed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.182981 Aug 18 11:06:23.646690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 213/446] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:23 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:06:24.187739 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b6cdac64-296e-4ebc-816e-b67d17a0e468 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:24.188315 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b6cdac64-296e-4ebc-816e-b67d17a0e468 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:24.197149 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b6cdac64-296e-4ebc-816e-b67d17a0e468 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:24.197671 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b6cdac64-296e-4ebc-816e-b67d17a0e468 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:24.198109 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b6cdac64-296e-4ebc-816e-b67d17a0e468 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:24.198805 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b6cdac64-296e-4ebc-816e-b67d17a0e468 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:24.199259 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b6cdac64-296e-4ebc-816e-b67d17a0e468 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:24.199802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b6cdac64-296e-4ebc-816e-b67d17a0e468 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:24.230149 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b6cdac64-296e-4ebc-816e-b67d17a0e468 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8/ips" status: 200 len: 149 microversion: 2.1 time: 0.046344 Aug 18 11:06:24.230725 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 214/447] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Aug 18 11:06:24 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:06:24.246127 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68f9e8a3-af98-49c1-9021-f31c1dfe55bb"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:24.248568 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:24.255751 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:24.256240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:24.256709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:24.257414 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:24.257898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:24.258322 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:24.348690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Invalid volume: volume 68f9e8a3-af98-49c1-9021-f31c1dfe55bb is already attached to instances: f36caff1-93fb-4fd8-8727-9aa6b23ee576 Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: POST /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8/os-volume_attachments HTTP/1.1 Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 74 Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:06:24.350459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {"volumeAttachment": {"volumeId": "68f9e8a3-af98-49c1-9021-f31c1dfe55bb"}} Aug 18 11:06:24.352073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Invalid volume: volume 68f9e8a3-af98-49c1-9021-f31c1dfe55bb is already attached to instances: f36caff1-93fb-4fd8-8727-9aa6b23ee576 Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'server_id': '1f24c60c-50af-4a18-bd0a-20de259bc3c8', 'body': {'volumeAttachment': {'volumeId': '68f9e8a3-af98-49c1-9021-f31c1dfe55bb'}}} Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 68f9e8a3-af98-49c1-9021-f31c1dfe55bb is already attached to instances: f36caff1-93fb-4fd8-8727-9aa6b23ee576 Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:06:24.352949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 68f9e8a3-af98-49c1-9021-f31c1dfe55bb is already attached to instances: f36caff1-93fb-4fd8-8727-9aa6b23ee576 Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:24.354663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:06:24.356575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:06:24.356575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:06:24.356575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:06:24.356575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 68f9e8a3-af98-49c1-9021-f31c1dfe55bb is already attached to instances: f36caff1-93fb-4fd8-8727-9aa6b23ee576 Aug 18 11:06:24.356575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:06:24.356575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 400 to user: Invalid volume: volume 68f9e8a3-af98-49c1-9021-f31c1dfe55bb is already attached to instances: f36caff1-93fb-4fd8-8727-9aa6b23ee576 {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:06:24.356575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0fdaaa8e-bc7e-4388-9054-fdb0f7949a54 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111824 Aug 18 11:06:24.356575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 215/448] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:06:24 2022] POST /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 11:06:24.361792 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f6de662a-56a1-4b3b-9019-c2e8d702d03f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:24.362325 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f6de662a-56a1-4b3b-9019-c2e8d702d03f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:24.369417 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f6de662a-56a1-4b3b-9019-c2e8d702d03f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:24.369922 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f6de662a-56a1-4b3b-9019-c2e8d702d03f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:24.370351 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f6de662a-56a1-4b3b-9019-c2e8d702d03f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:24.371039 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f6de662a-56a1-4b3b-9019-c2e8d702d03f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:24.371492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f6de662a-56a1-4b3b-9019-c2e8d702d03f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:24.371909 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f6de662a-56a1-4b3b-9019-c2e8d702d03f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:24.398009 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f6de662a-56a1-4b3b-9019-c2e8d702d03f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:06:24.475922 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f6de662a-56a1-4b3b-9019-c2e8d702d03f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 204 len: 0 microversion: 2.1 time: 0.117777 Aug 18 11:06:24.476742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 216/449] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:06:24 2022] DELETE /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:06:24.485264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fea60b34-8edc-4db3-9b86-9bfccd3e5e14 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:24.485979 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fea60b34-8edc-4db3-9b86-9bfccd3e5e14 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:24.491529 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea60b34-8edc-4db3-9b86-9bfccd3e5e14 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:24.492012 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea60b34-8edc-4db3-9b86-9bfccd3e5e14 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:24.492444 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea60b34-8edc-4db3-9b86-9bfccd3e5e14 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:24.493124 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea60b34-8edc-4db3-9b86-9bfccd3e5e14 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:24.493592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea60b34-8edc-4db3-9b86-9bfccd3e5e14 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:24.494015 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea60b34-8edc-4db3-9b86-9bfccd3e5e14 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:24.637207 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fea60b34-8edc-4db3-9b86-9bfccd3e5e14 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:24.644939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fea60b34-8edc-4db3-9b86-9bfccd3e5e14 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1679 microversion: 2.1 time: 0.164230 Aug 18 11:06:24.645498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 217/450] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:24 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:06:24.654709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:24.655404 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:24.661545 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:24.662050 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:24.662492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:24.663181 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:24.663638 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:24.664063 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:24.810905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:24.820184 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:24.821732 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:24.822886 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-02dd5d2e-e5a8-4a26-8098-e47f9108367e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.172103 Aug 18 11:06:24.823440 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 218/451] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:24 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:06:25.666860 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1ed0c595-a3ce-4bcc-abf6-5ac05f537e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:25.667510 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1ed0c595-a3ce-4bcc-abf6-5ac05f537e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:25.674299 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed0c595-a3ce-4bcc-abf6-5ac05f537e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:25.674845 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed0c595-a3ce-4bcc-abf6-5ac05f537e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:25.675309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed0c595-a3ce-4bcc-abf6-5ac05f537e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:25.676043 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed0c595-a3ce-4bcc-abf6-5ac05f537e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:25.676552 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed0c595-a3ce-4bcc-abf6-5ac05f537e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:25.677031 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ed0c595-a3ce-4bcc-abf6-5ac05f537e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:25.808512 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1ed0c595-a3ce-4bcc-abf6-5ac05f537e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:25.816905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1ed0c595-a3ce-4bcc-abf6-5ac05f537e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1679 microversion: 2.1 time: 0.154345 Aug 18 11:06:25.817667 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 219/452] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:25 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:06:25.847267 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:25.847795 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:25.853747 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:25.854235 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:25.854675 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:25.855356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:25.855812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:25.856236 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:25.998834 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:26.008203 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:26.009760 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:26.010918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b2c88a34-2506-4912-8b30-227eb4f06607 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.167978 Aug 18 11:06:26.011482 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 220/453] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:25 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:06:26.330376 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bc6c8dad-3c1e-40a7-9fdd-db3e7307e3a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.119528 Aug 18 11:06:26.331160 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 234/454] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:06:22 2022] POST /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments => generated 194 bytes in 4121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:26.838958 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d8907eec-b433-4dee-bb82-76b6d2ebc5ef tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:26.839675 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d8907eec-b433-4dee-bb82-76b6d2ebc5ef tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:26.848128 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8907eec-b433-4dee-bb82-76b6d2ebc5ef tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:26.848730 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8907eec-b433-4dee-bb82-76b6d2ebc5ef tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:26.849312 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8907eec-b433-4dee-bb82-76b6d2ebc5ef tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:26.850043 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8907eec-b433-4dee-bb82-76b6d2ebc5ef tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:26.850503 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8907eec-b433-4dee-bb82-76b6d2ebc5ef tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:26.850915 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8907eec-b433-4dee-bb82-76b6d2ebc5ef tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:27.035421 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:27.036373 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:27.043301 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:27.043784 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:27.044244 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:27.044958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:27.045414 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:27.045931 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:27.056653 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d8907eec-b433-4dee-bb82-76b6d2ebc5ef tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:27.064467 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d8907eec-b433-4dee-bb82-76b6d2ebc5ef tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1679 microversion: 2.1 time: 0.229167 Aug 18 11:06:27.065234 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 221/455] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:26 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:27.183782 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:27.192713 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:27.194271 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:27.195438 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-13fec1d6-24cf-4339-9b39-9e8c7a6b8211 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.164982 Aug 18 11:06:27.196065 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 235/456] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:27 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:06:27.855224 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-735787cc-98df-44b9-9436-3f8d6dbe8ab4 req-2dd21076-aac4-41ac-a7d2-724b41ae3586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f24c60c-50af-4a18-bd0a-20de259bc3c8", "name": "network-vif-deleted", "tag": "38d8f7be-04b7-4a8b-ab84-70a8f2444464"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:27.868234 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-735787cc-98df-44b9-9436-3f8d6dbe8ab4 req-2dd21076-aac4-41ac-a7d2-724b41ae3586 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:27.869079 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-735787cc-98df-44b9-9436-3f8d6dbe8ab4 req-2dd21076-aac4-41ac-a7d2-724b41ae3586 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:27.869741 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-735787cc-98df-44b9-9436-3f8d6dbe8ab4 req-2dd21076-aac4-41ac-a7d2-724b41ae3586 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:27.884299 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-735787cc-98df-44b9-9436-3f8d6dbe8ab4 req-2dd21076-aac4-41ac-a7d2-724b41ae3586 service nova] Creating event network-vif-deleted:38d8f7be-04b7-4a8b-ab84-70a8f2444464 for instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 on hv-cinder-82660 Aug 18 11:06:27.893204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-735787cc-98df-44b9-9436-3f8d6dbe8ab4 req-2dd21076-aac4-41ac-a7d2-724b41ae3586 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041579 Aug 18 11:06:27.894485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 222/457] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:28.086227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:28.087162 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:28.094067 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:28.095236 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:28.096004 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:28.096490 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:28.097063 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:28.097734 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:28.131672 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:28.132168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:28.132823 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:28.133294 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lazy-loading 'fault' on Instance uuid 1f24c60c-50af-4a18-bd0a-20de259bc3c8 {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:06:28.185790 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:28.194552 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7925f3cc-d11f-48db-a104-bc87a38b0c84 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 200 len: 1330 microversion: 2.1 time: 0.112660 Aug 18 11:06:28.195135 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 236/458] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:28 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 1330 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:28.223716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:28.224649 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:28.232028 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:28.232995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:28.233495 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:28.234366 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:28.234886 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:28.236093 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:28.402327 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:28.412548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:28.414202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:28.415376 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-690d0588-c99b-4315-a9ea-687f6c428773 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.199263 Aug 18 11:06:28.415936 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 223/459] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:28 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:29.216102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:29.217372 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:29.226483 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:29.227224 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:29.227838 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:29.228729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:29.229389 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:29.229995 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:29.247364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 HTTP/1.1 Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:06:29.249193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:06:29.252072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '1f24c60c-50af-4a18-bd0a-20de259bc3c8'} Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:06:29.252844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:06:29.254365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:06:29.255694 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:06:29.255694 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-52a3a809-4f0a-4b70-add3-1b996a5f1963 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 404 len: 111 microversion: 2.1 time: 0.038876 Aug 18 11:06:29.261374 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-018a44bb-9c4b-48bd-a1c0-c4db74b850b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '.version_select at 0x7f7ec8c0eb80>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:29.265701 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 237/460] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:29 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:06:29.316829 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-018a44bb-9c4b-48bd-a1c0-c4db74b850b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-272890334" status: 202 len: 0 microversion: 2.1 time: 0.059509 Aug 18 11:06:29.317578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 224/461] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Aug 18 11:06:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-272890334 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:06:29.440229 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:29.440967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:29.447099 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:29.447658 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:29.448176 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:29.448987 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:29.449542 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:29.450139 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:29.600660 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:29.611461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:29.613704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:29.614939 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-cb717585-2da4-4970-8d58-f2331df4505f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.179939 Aug 18 11:06:29.615827 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 238/462] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:29 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:30.033177 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f4da0d27-669c-4231-95bf-12de12f29529 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:30.033796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f4da0d27-669c-4231-95bf-12de12f29529 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:30.046921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4da0d27-669c-4231-95bf-12de12f29529 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:30.047859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4da0d27-669c-4231-95bf-12de12f29529 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:30.048308 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4da0d27-669c-4231-95bf-12de12f29529 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:30.049200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4da0d27-669c-4231-95bf-12de12f29529 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:30.050096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4da0d27-669c-4231-95bf-12de12f29529 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:30.050700 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4da0d27-669c-4231-95bf-12de12f29529 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:30.187212 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-f4da0d27-669c-4231-95bf-12de12f29529 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lazy-loading 'services' on Instance uuid f36caff1-93fb-4fd8-8727-9aa6b23ee576 {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:06:30.308750 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f4da0d27-669c-4231-95bf-12de12f29529 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments/68f9e8a3-af98-49c1-9021-f31c1dfe55bb" status: 202 len: 0 microversion: 2.1 time: 0.280038 Aug 18 11:06:30.309412 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 225/463] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:06:30 2022] DELETE /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments/68f9e8a3-af98-49c1-9021-f31c1dfe55bb => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:06:30.319066 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-67ac58e5-120c-478a-b2e6-c0f570c145e8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:30.321346 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-67ac58e5-120c-478a-b2e6-c0f570c145e8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:30.327958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67ac58e5-120c-478a-b2e6-c0f570c145e8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:30.328484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67ac58e5-120c-478a-b2e6-c0f570c145e8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:30.329509 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67ac58e5-120c-478a-b2e6-c0f570c145e8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:30.330393 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67ac58e5-120c-478a-b2e6-c0f570c145e8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:30.331266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67ac58e5-120c-478a-b2e6-c0f570c145e8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:30.331736 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67ac58e5-120c-478a-b2e6-c0f570c145e8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:30.365557 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-67ac58e5-120c-478a-b2e6-c0f570c145e8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050264 Aug 18 11:06:30.366454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 239/464] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:06:30 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:06:30.638793 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:30.639488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:30.646317 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:30.646830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:30.647266 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:30.647952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:30.648399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:30.648821 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:30.777900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:30.786358 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:30.787897 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:30.789056 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-505d213c-a74d-4f2f-a7ae-8d1dee72a829 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.154548 Aug 18 11:06:30.789627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 226/465] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:30 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:31.378810 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f29c5010-980d-417f-8732-6e290c9ee702 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:31.381000 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f29c5010-980d-417f-8732-6e290c9ee702 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:31.387416 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f29c5010-980d-417f-8732-6e290c9ee702 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:31.387897 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f29c5010-980d-417f-8732-6e290c9ee702 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:31.388332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f29c5010-980d-417f-8732-6e290c9ee702 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:31.389014 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f29c5010-980d-417f-8732-6e290c9ee702 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:31.389466 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f29c5010-980d-417f-8732-6e290c9ee702 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:31.389909 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f29c5010-980d-417f-8732-6e290c9ee702 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:31.420321 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f29c5010-980d-417f-8732-6e290c9ee702 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045543 Aug 18 11:06:31.420875 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 240/466] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:06:31 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:31.812781 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:31.814119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:31.820520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:31.821004 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:31.821443 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:31.822163 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:31.822617 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:31.823045 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:31.953966 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:31.962415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:31.963895 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:31.965034 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-53c95ba4-135e-42a4-9ab2-96749aaabcf1 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.156210 Aug 18 11:06:31.965645 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 227/467] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:31 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:32.433476 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6e69081a-7981-47b3-a578-a5eef951975e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:32.435640 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6e69081a-7981-47b3-a578-a5eef951975e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:32.443027 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e69081a-7981-47b3-a578-a5eef951975e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:32.443511 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e69081a-7981-47b3-a578-a5eef951975e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:32.443947 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e69081a-7981-47b3-a578-a5eef951975e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:32.444640 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e69081a-7981-47b3-a578-a5eef951975e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:32.445095 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e69081a-7981-47b3-a578-a5eef951975e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:32.445546 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e69081a-7981-47b3-a578-a5eef951975e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:32.477315 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6e69081a-7981-47b3-a578-a5eef951975e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047631 Aug 18 11:06:32.477839 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 241/468] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:06:32 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:32.988879 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:32.989483 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:32.996487 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:32.996960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:32.997387 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:32.998094 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:32.998540 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:32.998958 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:33.136960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:33.145651 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:33.147151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:33.148304 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3541013e-0533-4a61-b619-68be062e3535 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.164061 Aug 18 11:06:33.148853 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 228/469] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:32 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:33.490706 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6b013f7e-356d-47b3-8d02-e187b3e13467 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:33.492975 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6b013f7e-356d-47b3-8d02-e187b3e13467 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:33.499782 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b013f7e-356d-47b3-8d02-e187b3e13467 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:33.500298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b013f7e-356d-47b3-8d02-e187b3e13467 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:33.500813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b013f7e-356d-47b3-8d02-e187b3e13467 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:33.501609 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b013f7e-356d-47b3-8d02-e187b3e13467 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:33.502068 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b013f7e-356d-47b3-8d02-e187b3e13467 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:33.502494 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b013f7e-356d-47b3-8d02-e187b3e13467 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:33.533930 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6b013f7e-356d-47b3-8d02-e187b3e13467 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047184 Aug 18 11:06:33.534491 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 242/470] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:06:33 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:33.876026 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d7060253-4e06-4ab1-8f30-fe6daccd8cd6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:33.878320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d7060253-4e06-4ab1-8f30-fe6daccd8cd6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:33.884391 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7060253-4e06-4ab1-8f30-fe6daccd8cd6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:33.884879 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7060253-4e06-4ab1-8f30-fe6daccd8cd6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:33.885319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7060253-4e06-4ab1-8f30-fe6daccd8cd6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:33.886043 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7060253-4e06-4ab1-8f30-fe6daccd8cd6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:33.886515 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7060253-4e06-4ab1-8f30-fe6daccd8cd6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:33.887035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d7060253-4e06-4ab1-8f30-fe6daccd8cd6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:33.910969 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-d7060253-4e06-4ab1-8f30-fe6daccd8cd6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lazy-loading 'flavor' on Instance uuid db0e5602-14b6-4ab8-b7b7-0e383adf09be {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:06:33.924972 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:34.033860 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d7060253-4e06-4ab1-8f30-fe6daccd8cd6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/action" status: 200 len: 32 microversion: 2.1 time: 0.162143 Aug 18 11:06:34.034505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 229/471] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:06:33 2022] POST /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:06:34.044315 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-06204788-72c4-4851-bd6b-fe6905077b04 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:34.044921 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-06204788-72c4-4851-bd6b-fe6905077b04 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:34.051002 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06204788-72c4-4851-bd6b-fe6905077b04 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:34.051485 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06204788-72c4-4851-bd6b-fe6905077b04 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:34.051918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06204788-72c4-4851-bd6b-fe6905077b04 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:34.052606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06204788-72c4-4851-bd6b-fe6905077b04 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:34.053159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06204788-72c4-4851-bd6b-fe6905077b04 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:34.053637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06204788-72c4-4851-bd6b-fe6905077b04 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:34.174077 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:34.175041 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:34.183249 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:34.184496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:34.185695 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:34.187013 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:34.187686 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:34.188614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:34.207712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-06204788-72c4-4851-bd6b-fe6905077b04 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:34.222457 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-06204788-72c4-4851-bd6b-fe6905077b04 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.181990 Aug 18 11:06:34.224821 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 243/472] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:34 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:34.460769 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:34.474240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:34.475772 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:34.476963 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-af2060cd-368a-49fc-a726-e94d597fc4c3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.308838 Aug 18 11:06:34.477540 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 230/473] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:34 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:06:34.546610 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6837a659-0f3b-4eb9-a802-f506dd7e5fe3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:34.549117 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6837a659-0f3b-4eb9-a802-f506dd7e5fe3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:34.555779 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6837a659-0f3b-4eb9-a802-f506dd7e5fe3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:34.556272 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6837a659-0f3b-4eb9-a802-f506dd7e5fe3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:34.556683 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6837a659-0f3b-4eb9-a802-f506dd7e5fe3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:34.557432 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6837a659-0f3b-4eb9-a802-f506dd7e5fe3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:34.557929 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6837a659-0f3b-4eb9-a802-f506dd7e5fe3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:34.558326 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6837a659-0f3b-4eb9-a802-f506dd7e5fe3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:34.588788 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6837a659-0f3b-4eb9-a802-f506dd7e5fe3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046144 Aug 18 11:06:34.589670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 244/474] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:06:34 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:06:34.652600 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-40f89956-1da4-48ce-ab1c-9eddc8a832dc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:34.653237 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-40f89956-1da4-48ce-ab1c-9eddc8a832dc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:34.662451 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-40f89956-1da4-48ce-ab1c-9eddc8a832dc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:34.663583 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-40f89956-1da4-48ce-ab1c-9eddc8a832dc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:34.664132 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-40f89956-1da4-48ce-ab1c-9eddc8a832dc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:34.664921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-40f89956-1da4-48ce-ab1c-9eddc8a832dc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:34.665480 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-40f89956-1da4-48ce-ab1c-9eddc8a832dc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:34.666015 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-40f89956-1da4-48ce-ab1c-9eddc8a832dc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:34.694840 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-40f89956-1da4-48ce-ab1c-9eddc8a832dc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:06:34.789959 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-40f89956-1da4-48ce-ab1c-9eddc8a832dc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 204 len: 0 microversion: 2.1 time: 0.140516 Aug 18 11:06:34.791111 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 231/475] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:06:34 2022] DELETE /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:06:34.803630 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-80b15026-d12b-4fa2-8268-f9471d9a791b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:34.805120 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-80b15026-d12b-4fa2-8268-f9471d9a791b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:34.812604 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-80b15026-d12b-4fa2-8268-f9471d9a791b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:34.813172 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-80b15026-d12b-4fa2-8268-f9471d9a791b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:34.813998 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-80b15026-d12b-4fa2-8268-f9471d9a791b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:34.814783 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-80b15026-d12b-4fa2-8268-f9471d9a791b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:34.815244 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-80b15026-d12b-4fa2-8268-f9471d9a791b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:34.815677 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-80b15026-d12b-4fa2-8268-f9471d9a791b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:34.957771 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-80b15026-d12b-4fa2-8268-f9471d9a791b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:34.965319 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-80b15026-d12b-4fa2-8268-f9471d9a791b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1680 microversion: 2.1 time: 0.168548 Aug 18 11:06:34.965898 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 245/476] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:34 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:35.249791 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d3380a9b-8c17-4497-bd86-f64c03b05590 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:35.250479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d3380a9b-8c17-4497-bd86-f64c03b05590 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:35.257007 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3380a9b-8c17-4497-bd86-f64c03b05590 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:35.257483 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3380a9b-8c17-4497-bd86-f64c03b05590 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:35.257940 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3380a9b-8c17-4497-bd86-f64c03b05590 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:35.258625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3380a9b-8c17-4497-bd86-f64c03b05590 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:35.259069 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3380a9b-8c17-4497-bd86-f64c03b05590 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:35.259484 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d3380a9b-8c17-4497-bd86-f64c03b05590 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:35.394829 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d3380a9b-8c17-4497-bd86-f64c03b05590 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:35.402811 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d3380a9b-8c17-4497-bd86-f64c03b05590 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.157229 Aug 18 11:06:35.403378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 232/477] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:35 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:35.501390 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:35.502268 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:35.508471 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:35.508949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:35.509412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:35.510204 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:35.510675 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:35.511094 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:35.643941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:35.652404 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:35.653903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:35.655051 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-266108aa-dcd7-4680-abcb-80b8a3884abc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.158347 Aug 18 11:06:35.655601 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 246/478] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:35 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:06:35.986859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-566c22f7-598c-4e34-99ff-9e3bcf7a6f74 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:35.987499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-566c22f7-598c-4e34-99ff-9e3bcf7a6f74 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:35.993473 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-566c22f7-598c-4e34-99ff-9e3bcf7a6f74 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:35.993982 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-566c22f7-598c-4e34-99ff-9e3bcf7a6f74 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:35.994411 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-566c22f7-598c-4e34-99ff-9e3bcf7a6f74 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:35.995092 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-566c22f7-598c-4e34-99ff-9e3bcf7a6f74 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:35.995539 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-566c22f7-598c-4e34-99ff-9e3bcf7a6f74 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:35.995955 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-566c22f7-598c-4e34-99ff-9e3bcf7a6f74 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:36.128208 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-566c22f7-598c-4e34-99ff-9e3bcf7a6f74 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:36.151683 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-566c22f7-598c-4e34-99ff-9e3bcf7a6f74 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1680 microversion: 2.1 time: 0.169080 Aug 18 11:06:36.152580 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 233/479] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:35 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:36.313128 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-d2aefe4d-ce8c-4207-9758-55dca39fcd28 req-e83eac3a-a3a0-42a6-9c13-009e556d3fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e210ba46-e81e-4939-b202-4b569f906d8b", "name": "network-vif-plugged", "status": "completed", "tag": "850023d2-3a9f-4c57-85af-2b31e7f7b114"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:36.323495 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-d2aefe4d-ce8c-4207-9758-55dca39fcd28 req-e83eac3a-a3a0-42a6-9c13-009e556d3fa7 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:36.324073 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-d2aefe4d-ce8c-4207-9758-55dca39fcd28 req-e83eac3a-a3a0-42a6-9c13-009e556d3fa7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:36.324573 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-d2aefe4d-ce8c-4207-9758-55dca39fcd28 req-e83eac3a-a3a0-42a6-9c13-009e556d3fa7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:36.337177 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-d2aefe4d-ce8c-4207-9758-55dca39fcd28 req-e83eac3a-a3a0-42a6-9c13-009e556d3fa7 service nova] Creating event network-vif-plugged:850023d2-3a9f-4c57-85af-2b31e7f7b114 for instance e210ba46-e81e-4939-b202-4b569f906d8b on hv-cinder-82660 Aug 18 11:06:36.346434 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-d2aefe4d-ce8c-4207-9758-55dca39fcd28 req-e83eac3a-a3a0-42a6-9c13-009e556d3fa7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038403 Aug 18 11:06:36.347446 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 247/480] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:36.426241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e6bab3ef-9ce8-4c8c-bb6e-8b9d341d8059 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:36.426884 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e6bab3ef-9ce8-4c8c-bb6e-8b9d341d8059 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:36.433321 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bab3ef-9ce8-4c8c-bb6e-8b9d341d8059 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:36.433848 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bab3ef-9ce8-4c8c-bb6e-8b9d341d8059 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:36.434287 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bab3ef-9ce8-4c8c-bb6e-8b9d341d8059 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:36.434980 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bab3ef-9ce8-4c8c-bb6e-8b9d341d8059 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:36.435435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bab3ef-9ce8-4c8c-bb6e-8b9d341d8059 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:36.435863 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e6bab3ef-9ce8-4c8c-bb6e-8b9d341d8059 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:36.577267 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e6bab3ef-9ce8-4c8c-bb6e-8b9d341d8059 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:36.585936 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e6bab3ef-9ce8-4c8c-bb6e-8b9d341d8059 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.164371 Aug 18 11:06:36.586515 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 234/481] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:36 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:36.679026 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:36.679842 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:36.686042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:36.686521 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:36.686949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:36.687648 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:36.688159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:36.688672 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:37.100066 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:37.108828 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:37.110509 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:37.111668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ee48516f-b281-41e8-a9af-e023f5c3bba5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.437323 Aug 18 11:06:37.112544 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 248/482] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:36 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:37.172790 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7d967b56-789d-41f1-baf1-8fab31270a82 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:37.173570 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7d967b56-789d-41f1-baf1-8fab31270a82 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:37.179867 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d967b56-789d-41f1-baf1-8fab31270a82 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:37.180349 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d967b56-789d-41f1-baf1-8fab31270a82 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:37.180786 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d967b56-789d-41f1-baf1-8fab31270a82 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:37.181479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d967b56-789d-41f1-baf1-8fab31270a82 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:37.181957 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d967b56-789d-41f1-baf1-8fab31270a82 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:37.182378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7d967b56-789d-41f1-baf1-8fab31270a82 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:37.397204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7d967b56-789d-41f1-baf1-8fab31270a82 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:37.406222 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7d967b56-789d-41f1-baf1-8fab31270a82 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1680 microversion: 2.1 time: 0.237452 Aug 18 11:06:37.406854 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 235/483] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:37 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1680 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:37.608111 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-076c95aa-e223-4b2c-9aa0-099f6a2d946e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:37.608759 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-076c95aa-e223-4b2c-9aa0-099f6a2d946e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:37.616266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-076c95aa-e223-4b2c-9aa0-099f6a2d946e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:37.616765 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-076c95aa-e223-4b2c-9aa0-099f6a2d946e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:37.617207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-076c95aa-e223-4b2c-9aa0-099f6a2d946e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:37.617951 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-076c95aa-e223-4b2c-9aa0-099f6a2d946e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:37.618413 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-076c95aa-e223-4b2c-9aa0-099f6a2d946e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:37.618844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-076c95aa-e223-4b2c-9aa0-099f6a2d946e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:37.623559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:37.764282 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-076c95aa-e223-4b2c-9aa0-099f6a2d946e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:37.772504 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-076c95aa-e223-4b2c-9aa0-099f6a2d946e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.168285 Aug 18 11:06:37.773164 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 249/484] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:37 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:37.895655 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-17f201c6-b153-45ac-943d-72e7ef352acd req-1ac56835-c0d1-4a34-a82b-af814cb533e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36caff1-93fb-4fd8-8727-9aa6b23ee576", "name": "network-vif-deleted", "tag": "d14edd58-652d-4c9e-b988-a4e1b455c2b1"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:37.905622 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-17f201c6-b153-45ac-943d-72e7ef352acd req-1ac56835-c0d1-4a34-a82b-af814cb533e9 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:37.906096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-17f201c6-b153-45ac-943d-72e7ef352acd req-1ac56835-c0d1-4a34-a82b-af814cb533e9 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:37.907133 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-17f201c6-b153-45ac-943d-72e7ef352acd req-1ac56835-c0d1-4a34-a82b-af814cb533e9 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:37.918659 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-17f201c6-b153-45ac-943d-72e7ef352acd req-1ac56835-c0d1-4a34-a82b-af814cb533e9 service nova] Creating event network-vif-deleted:d14edd58-652d-4c9e-b988-a4e1b455c2b1 for instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 on hv-cinder-82660 Aug 18 11:06:37.924828 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-17f201c6-b153-45ac-943d-72e7ef352acd req-1ac56835-c0d1-4a34-a82b-af814cb533e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032729 Aug 18 11:06:37.925580 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 236/485] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:38.135090 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:38.135649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:38.142369 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:38.142862 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:38.143304 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:38.144206 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:38.144671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:38.145627 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:38.287442 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:38.296451 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:38.298163 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:38.299349 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e0271ed8-035a-49af-b5d1-145026a46c05 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1809 microversion: 2.20 time: 0.168313 Aug 18 11:06:38.299909 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 250/486] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:38 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:38.428651 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:38.429257 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:38.435741 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:38.436519 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:38.436950 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:38.438389 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:38.438912 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:38.439386 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:38.475446 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:38.475936 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:38.476374 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:38.476833 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lazy-loading 'fault' on Instance uuid f36caff1-93fb-4fd8-8727-9aa6b23ee576 {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:06:38.526522 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:38.535096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1a20e05c-616e-4845-ae86-2ecc1d614ac9 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 200 len: 1331 microversion: 2.1 time: 0.110770 Aug 18 11:06:38.535680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 237/487] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:38 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:06:38.794189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bc831e3f-1c5f-4ffb-ad93-b2ce3a07ce25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:38.794790 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bc831e3f-1c5f-4ffb-ad93-b2ce3a07ce25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:38.804009 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc831e3f-1c5f-4ffb-ad93-b2ce3a07ce25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:38.804593 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc831e3f-1c5f-4ffb-ad93-b2ce3a07ce25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:38.805168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc831e3f-1c5f-4ffb-ad93-b2ce3a07ce25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:38.806030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc831e3f-1c5f-4ffb-ad93-b2ce3a07ce25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:38.806481 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc831e3f-1c5f-4ffb-ad93-b2ce3a07ce25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:38.807102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bc831e3f-1c5f-4ffb-ad93-b2ce3a07ce25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:38.984920 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bc831e3f-1c5f-4ffb-ad93-b2ce3a07ce25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:38.994386 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bc831e3f-1c5f-4ffb-ad93-b2ce3a07ce25 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.204159 Aug 18 11:06:38.995504 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 251/488] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:38 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:39.323825 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:39.324742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:39.332480 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:39.333067 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:39.333511 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:39.334281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:39.334743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:39.335184 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:39.469049 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:39.478375 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:39.479919 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:39.481628 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e5913d7e-f2ef-4224-baac-b86c2b218d5b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1796 microversion: 2.20 time: 0.161327 Aug 18 11:06:39.481821 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 238/489] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:06:39 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1796 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:06:39.558032 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:39.558642 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:39.565366 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:39.565883 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:39.566320 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:39.567002 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:39.567453 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:39.567872 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:39.582094 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 HTTP/1.1 Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:06:39.583762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:06:39.585249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': 'f36caff1-93fb-4fd8-8727-9aa6b23ee576'} Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:06:39.586081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:06:39.587549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:06:39.588789 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:06:39.588789 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1ea8ad5c-57ec-4559-9251-1e7038a5c582 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 404 len: 111 microversion: 2.1 time: 0.031017 Aug 18 11:06:39.588789 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 252/490] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:39 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:06:39.594342 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b35c69e6-18b3-4d14-941a-db855bf52b85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '.version_select at 0x7f7ec8ac30d0>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:39.614934 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b35c69e6-18b3-4d14-941a-db855bf52b85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-121521980" status: 202 len: 0 microversion: 2.1 time: 0.024505 Aug 18 11:06:39.615511 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 239/491] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Aug 18 11:06:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-121521980 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:06:40.016291 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7ad7b592-f2c9-4e2d-9810-291810c9e495 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:40.016914 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7ad7b592-f2c9-4e2d-9810-291810c9e495 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:40.023502 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7ad7b592-f2c9-4e2d-9810-291810c9e495 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:40.024146 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7ad7b592-f2c9-4e2d-9810-291810c9e495 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:40.024432 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7ad7b592-f2c9-4e2d-9810-291810c9e495 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:40.025133 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7ad7b592-f2c9-4e2d-9810-291810c9e495 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:40.025619 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7ad7b592-f2c9-4e2d-9810-291810c9e495 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:40.026069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7ad7b592-f2c9-4e2d-9810-291810c9e495 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:40.161164 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7ad7b592-f2c9-4e2d-9810-291810c9e495 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:40.172864 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7ad7b592-f2c9-4e2d-9810-291810c9e495 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.159667 Aug 18 11:06:40.176872 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 253/492] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:40 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:40.246017 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3ec642e6-e517-4c21-a382-bb4acac8b06c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: .version_select at 0x7f7ec8a793a0>, body: {"keypair": {"name": "tempest-keypair-1426675827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyDKUq4V76G6GukaR5s96rmdmtCIEZmFcFbHCjT/SVVLZA2EBrQ1sxnAGDPi/o3sooXynWZvjqy2vdNEI1ZXyX/PPDphBDPFgyUidKiTooLt+8GBKtXgomqNysamhe9sg=="}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:40.261944 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-3ec642e6-e517-4c21-a382-bb4acac8b06c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for project 397eac573c2d473e881b07c87255700c. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:06:40.266007 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-3ec642e6-e517-4c21-a382-bb4acac8b06c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for user 57e117589fc14e4d9d8d8494bddf9c12 and project 397eac573c2d473e881b07c87255700c. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:06:40.294722 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3ec642e6-e517-4c21-a382-bb4acac8b06c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052729 Aug 18 11:06:40.295274 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 240/493] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Aug 18 11:06:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:41.194377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-90c241ee-21eb-41b1-8ed5-0bc00daffcbb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:41.194931 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-90c241ee-21eb-41b1-8ed5-0bc00daffcbb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:41.205444 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-90c241ee-21eb-41b1-8ed5-0bc00daffcbb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:41.205978 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-90c241ee-21eb-41b1-8ed5-0bc00daffcbb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:41.206413 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-90c241ee-21eb-41b1-8ed5-0bc00daffcbb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:41.207231 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-90c241ee-21eb-41b1-8ed5-0bc00daffcbb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:41.207583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-90c241ee-21eb-41b1-8ed5-0bc00daffcbb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:41.208258 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-90c241ee-21eb-41b1-8ed5-0bc00daffcbb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:41.357129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-90c241ee-21eb-41b1-8ed5-0bc00daffcbb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:41.366441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-90c241ee-21eb-41b1-8ed5-0bc00daffcbb tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.176038 Aug 18 11:06:41.367158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 254/494] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:41 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:41.602247 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1654233610", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88f1fd75-57ea-4549-97f2-02b6b8fc6e1b"}], "security_groups": [{"name": "tempest-securitygroup--114070495"}], "key_name": "tempest-keypair-1426675827", "user_data": "}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:41.707445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] validate_networks() for [('88f1fd75-57ea-4549-97f2-02b6b8fc6e1b', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:06:42.085578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:06:42.086036 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:06:42.086507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:06:42.086915 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:06:42.087321 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:06:42.096725 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:42.097204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:42.097672 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:42.098392 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:42.098841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:42.099265 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:42.115633 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for project 397eac573c2d473e881b07c87255700c. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:06:42.117839 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:42.120159 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for user 57e117589fc14e4d9d8d8494bddf9c12 and project 397eac573c2d473e881b07c87255700c. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:06:42.133491 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:06:42.135769 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:06:42.182510 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c799153e-3aa9-4a77-b3b4-fe77abe20398 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.585115 Aug 18 11:06:42.183412 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 241/495] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:06:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:06:42.194865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-69935844-382b-4a95-92e6-a8e5c03b7958 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:42.195481 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-69935844-382b-4a95-92e6-a8e5c03b7958 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:42.262769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-69935844-382b-4a95-92e6-a8e5c03b7958 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:42.270397 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-69935844-382b-4a95-92e6-a8e5c03b7958 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1242 microversion: 2.1 time: 0.079286 Aug 18 11:06:42.271150 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 255/496] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:42 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:42.388708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-852bfa87-6f7a-468f-8e0c-ba8f33677e3d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:42.389386 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-852bfa87-6f7a-468f-8e0c-ba8f33677e3d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:42.396656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852bfa87-6f7a-468f-8e0c-ba8f33677e3d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:42.397142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852bfa87-6f7a-468f-8e0c-ba8f33677e3d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:42.397787 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852bfa87-6f7a-468f-8e0c-ba8f33677e3d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:42.398509 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852bfa87-6f7a-468f-8e0c-ba8f33677e3d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:42.398968 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852bfa87-6f7a-468f-8e0c-ba8f33677e3d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:42.399401 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852bfa87-6f7a-468f-8e0c-ba8f33677e3d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:42.538763 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-852bfa87-6f7a-468f-8e0c-ba8f33677e3d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:42.547138 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-852bfa87-6f7a-468f-8e0c-ba8f33677e3d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.162565 Aug 18 11:06:42.547733 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 242/497] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:42 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:06:43.292170 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-64a91316-c81f-403d-bdcd-eb1931b2755a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:43.293561 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-64a91316-c81f-403d-bdcd-eb1931b2755a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:43.302265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64a91316-c81f-403d-bdcd-eb1931b2755a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:43.302848 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64a91316-c81f-403d-bdcd-eb1931b2755a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:43.303489 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64a91316-c81f-403d-bdcd-eb1931b2755a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:43.304206 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64a91316-c81f-403d-bdcd-eb1931b2755a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:43.304665 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64a91316-c81f-403d-bdcd-eb1931b2755a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:43.305206 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-64a91316-c81f-403d-bdcd-eb1931b2755a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:43.374230 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-64a91316-c81f-403d-bdcd-eb1931b2755a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:43.382442 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-64a91316-c81f-403d-bdcd-eb1931b2755a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1300 microversion: 2.1 time: 0.094540 Aug 18 11:06:43.383024 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 256/498] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:43 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:43.570138 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-716d23f6-8c89-48d1-aabd-d115310bf5db tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:43.571353 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-716d23f6-8c89-48d1-aabd-d115310bf5db tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:43.578790 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-716d23f6-8c89-48d1-aabd-d115310bf5db tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:43.579345 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-716d23f6-8c89-48d1-aabd-d115310bf5db tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:43.579785 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-716d23f6-8c89-48d1-aabd-d115310bf5db tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:43.580496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-716d23f6-8c89-48d1-aabd-d115310bf5db tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:43.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-716d23f6-8c89-48d1-aabd-d115310bf5db tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:43.581368 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-716d23f6-8c89-48d1-aabd-d115310bf5db tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:43.817087 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-716d23f6-8c89-48d1-aabd-d115310bf5db tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:43.825574 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-716d23f6-8c89-48d1-aabd-d115310bf5db tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.259438 Aug 18 11:06:43.826174 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 243/499] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:43 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:44.405509 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c8f2eb38-b2b0-4acb-b0eb-84d4b498da08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:44.406137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c8f2eb38-b2b0-4acb-b0eb-84d4b498da08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:44.412753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f2eb38-b2b0-4acb-b0eb-84d4b498da08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:44.413235 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f2eb38-b2b0-4acb-b0eb-84d4b498da08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:44.413713 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f2eb38-b2b0-4acb-b0eb-84d4b498da08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:44.414403 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f2eb38-b2b0-4acb-b0eb-84d4b498da08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:44.414853 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f2eb38-b2b0-4acb-b0eb-84d4b498da08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:44.415467 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c8f2eb38-b2b0-4acb-b0eb-84d4b498da08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:44.555655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c8f2eb38-b2b0-4acb-b0eb-84d4b498da08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:44.564956 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c8f2eb38-b2b0-4acb-b0eb-84d4b498da08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1367 microversion: 2.1 time: 0.162190 Aug 18 11:06:44.565566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 257/500] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:44 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:44.587232 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-184011b4-70a1-4e5e-9dbd-47f6a75419ef req-9fa4b9c2-20c6-49e8-a3b4-190969879853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4d3790-5385-4465-bce8-56ca982c4847", "tag": "c9ccab46-14a6-448e-a1fb-213238710faa"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:44.598336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-184011b4-70a1-4e5e-9dbd-47f6a75419ef req-9fa4b9c2-20c6-49e8-a3b4-190969879853 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:44.599058 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-184011b4-70a1-4e5e-9dbd-47f6a75419ef req-9fa4b9c2-20c6-49e8-a3b4-190969879853 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:44.599484 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-184011b4-70a1-4e5e-9dbd-47f6a75419ef req-9fa4b9c2-20c6-49e8-a3b4-190969879853 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:44.612967 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-184011b4-70a1-4e5e-9dbd-47f6a75419ef req-9fa4b9c2-20c6-49e8-a3b4-190969879853 service nova] Creating event network-changed:c9ccab46-14a6-448e-a1fb-213238710faa for instance 1f4d3790-5385-4465-bce8-56ca982c4847 on hv-cinder-82660 Aug 18 11:06:44.618473 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-184011b4-70a1-4e5e-9dbd-47f6a75419ef req-9fa4b9c2-20c6-49e8-a3b4-190969879853 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035024 Aug 18 11:06:44.619385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 244/501] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:44.848539 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a1938267-35d1-41b8-9388-00166717d1b3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:44.849182 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a1938267-35d1-41b8-9388-00166717d1b3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:44.855318 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1938267-35d1-41b8-9388-00166717d1b3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:44.855806 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1938267-35d1-41b8-9388-00166717d1b3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:44.856246 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1938267-35d1-41b8-9388-00166717d1b3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:44.856943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1938267-35d1-41b8-9388-00166717d1b3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:44.857402 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1938267-35d1-41b8-9388-00166717d1b3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:44.857857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1938267-35d1-41b8-9388-00166717d1b3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:44.997095 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a1938267-35d1-41b8-9388-00166717d1b3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:45.005864 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a1938267-35d1-41b8-9388-00166717d1b3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.161391 Aug 18 11:06:45.006452 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 258/502] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:44 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:45.585903 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4b2d1249-e325-4ee8-9f00-e2915fbf59d2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:45.586604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4b2d1249-e325-4ee8-9f00-e2915fbf59d2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:45.592773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b2d1249-e325-4ee8-9f00-e2915fbf59d2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:45.593373 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b2d1249-e325-4ee8-9f00-e2915fbf59d2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:45.593708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b2d1249-e325-4ee8-9f00-e2915fbf59d2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:45.595064 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b2d1249-e325-4ee8-9f00-e2915fbf59d2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:45.595520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b2d1249-e325-4ee8-9f00-e2915fbf59d2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:45.595943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b2d1249-e325-4ee8-9f00-e2915fbf59d2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:45.736382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4b2d1249-e325-4ee8-9f00-e2915fbf59d2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:45.747494 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4b2d1249-e325-4ee8-9f00-e2915fbf59d2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1367 microversion: 2.1 time: 0.165842 Aug 18 11:06:45.748062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 245/503] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:45 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:46.027769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4c156368-127f-4a57-b07b-2122c0ae8d0b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:46.028495 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4c156368-127f-4a57-b07b-2122c0ae8d0b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:46.036179 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c156368-127f-4a57-b07b-2122c0ae8d0b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:46.036681 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c156368-127f-4a57-b07b-2122c0ae8d0b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:46.037102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c156368-127f-4a57-b07b-2122c0ae8d0b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:46.037949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c156368-127f-4a57-b07b-2122c0ae8d0b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:46.038469 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c156368-127f-4a57-b07b-2122c0ae8d0b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:46.038894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c156368-127f-4a57-b07b-2122c0ae8d0b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:46.175618 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4c156368-127f-4a57-b07b-2122c0ae8d0b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:46.186149 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4c156368-127f-4a57-b07b-2122c0ae8d0b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.162617 Aug 18 11:06:46.188286 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 259/504] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:46 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:46.768519 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b5688487-925b-4663-bfb8-8e92db8885f2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:46.769204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b5688487-925b-4663-bfb8-8e92db8885f2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:46.776185 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b5688487-925b-4663-bfb8-8e92db8885f2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:46.776669 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b5688487-925b-4663-bfb8-8e92db8885f2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:46.777103 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b5688487-925b-4663-bfb8-8e92db8885f2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:46.777839 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b5688487-925b-4663-bfb8-8e92db8885f2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:46.778289 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b5688487-925b-4663-bfb8-8e92db8885f2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:46.778711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b5688487-925b-4663-bfb8-8e92db8885f2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:46.916366 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b5688487-925b-4663-bfb8-8e92db8885f2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:46.920703 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:46.926758 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b5688487-925b-4663-bfb8-8e92db8885f2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1367 microversion: 2.1 time: 0.162412 Aug 18 11:06:46.927337 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 246/505] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:46 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:47.209195 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-676ac34f-3d71-4fcc-8e3a-a549048ee4e1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:47.209842 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-676ac34f-3d71-4fcc-8e3a-a549048ee4e1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:47.216352 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-676ac34f-3d71-4fcc-8e3a-a549048ee4e1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:47.216840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-676ac34f-3d71-4fcc-8e3a-a549048ee4e1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:47.217279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-676ac34f-3d71-4fcc-8e3a-a549048ee4e1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:47.218009 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-676ac34f-3d71-4fcc-8e3a-a549048ee4e1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:47.218466 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-676ac34f-3d71-4fcc-8e3a-a549048ee4e1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:47.219585 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-676ac34f-3d71-4fcc-8e3a-a549048ee4e1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:47.352849 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-676ac34f-3d71-4fcc-8e3a-a549048ee4e1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:47.361038 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-676ac34f-3d71-4fcc-8e3a-a549048ee4e1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.156186 Aug 18 11:06:47.361659 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 260/506] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:47 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:47.948614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-852f88c7-4e80-4c1c-a07b-4d22957980e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:47.949291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-852f88c7-4e80-4c1c-a07b-4d22957980e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:47.955944 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852f88c7-4e80-4c1c-a07b-4d22957980e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:47.956423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852f88c7-4e80-4c1c-a07b-4d22957980e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:47.956853 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852f88c7-4e80-4c1c-a07b-4d22957980e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:47.957556 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852f88c7-4e80-4c1c-a07b-4d22957980e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:47.958012 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852f88c7-4e80-4c1c-a07b-4d22957980e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:47.958429 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-852f88c7-4e80-4c1c-a07b-4d22957980e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:48.092216 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-852f88c7-4e80-4c1c-a07b-4d22957980e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:48.100502 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-852f88c7-4e80-4c1c-a07b-4d22957980e2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1367 microversion: 2.1 time: 0.156724 Aug 18 11:06:48.101110 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 247/507] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:47 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:48.362440 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-487d086d-f0f8-4fe6-a367-d41cf6f1e96f req-cac6370b-2bb3-4fdc-bd56-ad35c12d2aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4d3790-5385-4465-bce8-56ca982c4847", "name": "network-vif-plugged", "status": "completed", "tag": "c9ccab46-14a6-448e-a1fb-213238710faa"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:48.373403 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-487d086d-f0f8-4fe6-a367-d41cf6f1e96f req-cac6370b-2bb3-4fdc-bd56-ad35c12d2aa6 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:48.373958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-487d086d-f0f8-4fe6-a367-d41cf6f1e96f req-cac6370b-2bb3-4fdc-bd56-ad35c12d2aa6 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:48.374391 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-487d086d-f0f8-4fe6-a367-d41cf6f1e96f req-cac6370b-2bb3-4fdc-bd56-ad35c12d2aa6 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:48.381749 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8072b92e-ed66-484b-9546-83b356514f47 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:48.382911 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8072b92e-ed66-484b-9546-83b356514f47 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:48.386794 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-487d086d-f0f8-4fe6-a367-d41cf6f1e96f req-cac6370b-2bb3-4fdc-bd56-ad35c12d2aa6 service nova] Creating event network-vif-plugged:c9ccab46-14a6-448e-a1fb-213238710faa for instance 1f4d3790-5385-4465-bce8-56ca982c4847 on hv-cinder-82660 Aug 18 11:06:48.390255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8072b92e-ed66-484b-9546-83b356514f47 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:48.390861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8072b92e-ed66-484b-9546-83b356514f47 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:48.391533 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8072b92e-ed66-484b-9546-83b356514f47 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:48.392255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8072b92e-ed66-484b-9546-83b356514f47 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:48.392371 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-487d086d-f0f8-4fe6-a367-d41cf6f1e96f req-cac6370b-2bb3-4fdc-bd56-ad35c12d2aa6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034627 Aug 18 11:06:48.393139 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8072b92e-ed66-484b-9546-83b356514f47 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:48.393258 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 261/508] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:48.393395 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8072b92e-ed66-484b-9546-83b356514f47 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:48.536122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8072b92e-ed66-484b-9546-83b356514f47 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:48.544455 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8072b92e-ed66-484b-9546-83b356514f47 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.166642 Aug 18 11:06:48.545061 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 248/509] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:48 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:06:49.124460 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-593d87d0-dffc-4ed0-895f-171ff5d108d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:49.125828 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-593d87d0-dffc-4ed0-895f-171ff5d108d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:49.132388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-593d87d0-dffc-4ed0-895f-171ff5d108d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:49.132877 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-593d87d0-dffc-4ed0-895f-171ff5d108d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:49.133306 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-593d87d0-dffc-4ed0-895f-171ff5d108d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:49.134044 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-593d87d0-dffc-4ed0-895f-171ff5d108d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:49.134504 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-593d87d0-dffc-4ed0-895f-171ff5d108d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:49.134924 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-593d87d0-dffc-4ed0-895f-171ff5d108d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:49.271397 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-593d87d0-dffc-4ed0-895f-171ff5d108d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:49.279029 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-593d87d0-dffc-4ed0-895f-171ff5d108d4 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1367 microversion: 2.1 time: 0.160106 Aug 18 11:06:49.279634 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 262/510] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:49 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:49.567991 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4415c1e3-16f6-4c28-8dc0-8a1e56fe6710 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:49.568603 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4415c1e3-16f6-4c28-8dc0-8a1e56fe6710 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:49.575517 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4415c1e3-16f6-4c28-8dc0-8a1e56fe6710 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:49.576001 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4415c1e3-16f6-4c28-8dc0-8a1e56fe6710 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:49.576438 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4415c1e3-16f6-4c28-8dc0-8a1e56fe6710 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:49.577143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4415c1e3-16f6-4c28-8dc0-8a1e56fe6710 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:49.577636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4415c1e3-16f6-4c28-8dc0-8a1e56fe6710 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:49.578072 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4415c1e3-16f6-4c28-8dc0-8a1e56fe6710 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:49.989668 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4415c1e3-16f6-4c28-8dc0-8a1e56fe6710 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:49.997740 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4415c1e3-16f6-4c28-8dc0-8a1e56fe6710 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.433666 Aug 18 11:06:49.998303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 249/511] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:49 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:50.302329 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ceeebab9-2446-4765-a4b9-b51f85bfc1ea tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:50.302947 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ceeebab9-2446-4765-a4b9-b51f85bfc1ea tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:50.310213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ceeebab9-2446-4765-a4b9-b51f85bfc1ea tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:50.310806 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ceeebab9-2446-4765-a4b9-b51f85bfc1ea tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:50.311318 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ceeebab9-2446-4765-a4b9-b51f85bfc1ea tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:50.312127 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ceeebab9-2446-4765-a4b9-b51f85bfc1ea tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:50.313215 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ceeebab9-2446-4765-a4b9-b51f85bfc1ea tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:50.313684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ceeebab9-2446-4765-a4b9-b51f85bfc1ea tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:50.464642 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ceeebab9-2446-4765-a4b9-b51f85bfc1ea tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:50.473068 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ceeebab9-2446-4765-a4b9-b51f85bfc1ea tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1367 microversion: 2.1 time: 0.175132 Aug 18 11:06:50.474010 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 263/512] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:50 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:51.020086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b4d3ed21-7e88-4f31-a850-21a350f3227f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:51.020634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b4d3ed21-7e88-4f31-a850-21a350f3227f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:51.027101 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4d3ed21-7e88-4f31-a850-21a350f3227f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:51.027582 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4d3ed21-7e88-4f31-a850-21a350f3227f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:51.028017 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4d3ed21-7e88-4f31-a850-21a350f3227f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:51.028700 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4d3ed21-7e88-4f31-a850-21a350f3227f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:51.029150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4d3ed21-7e88-4f31-a850-21a350f3227f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:51.029612 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4d3ed21-7e88-4f31-a850-21a350f3227f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:51.163589 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b4d3ed21-7e88-4f31-a850-21a350f3227f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:51.171819 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b4d3ed21-7e88-4f31-a850-21a350f3227f tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.156204 Aug 18 11:06:51.172386 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 250/513] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:51 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:51.493286 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f6ff9fb7-94b4-42a1-8204-ed19c4f9931a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:51.493911 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f6ff9fb7-94b4-42a1-8204-ed19c4f9931a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:51.500912 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f6ff9fb7-94b4-42a1-8204-ed19c4f9931a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:51.501597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f6ff9fb7-94b4-42a1-8204-ed19c4f9931a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:51.502036 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f6ff9fb7-94b4-42a1-8204-ed19c4f9931a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:51.502727 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f6ff9fb7-94b4-42a1-8204-ed19c4f9931a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:51.503175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f6ff9fb7-94b4-42a1-8204-ed19c4f9931a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:51.503595 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f6ff9fb7-94b4-42a1-8204-ed19c4f9931a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:51.644462 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f6ff9fb7-94b4-42a1-8204-ed19c4f9931a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:51.652066 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f6ff9fb7-94b4-42a1-8204-ed19c4f9931a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1556 microversion: 2.1 time: 0.162661 Aug 18 11:06:51.652629 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 264/514] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:51 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:51.673852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ac015b5e-3ee6-4fef-b4cc-2469445ddcd1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:51.674341 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ac015b5e-3ee6-4fef-b4cc-2469445ddcd1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:51.680567 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac015b5e-3ee6-4fef-b4cc-2469445ddcd1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:51.681054 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac015b5e-3ee6-4fef-b4cc-2469445ddcd1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:51.681492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac015b5e-3ee6-4fef-b4cc-2469445ddcd1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:51.682216 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac015b5e-3ee6-4fef-b4cc-2469445ddcd1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:51.682667 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac015b5e-3ee6-4fef-b4cc-2469445ddcd1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:51.683092 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ac015b5e-3ee6-4fef-b4cc-2469445ddcd1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:51.764995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ac015b5e-3ee6-4fef-b4cc-2469445ddcd1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095537 Aug 18 11:06:51.765652 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 251/515] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Aug 18 11:06:51 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:52.194131 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-36738409-24bc-4b5b-90f7-4c8c9ebdb5f7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:52.194806 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-36738409-24bc-4b5b-90f7-4c8c9ebdb5f7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:52.200831 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36738409-24bc-4b5b-90f7-4c8c9ebdb5f7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:52.201410 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36738409-24bc-4b5b-90f7-4c8c9ebdb5f7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:52.202100 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36738409-24bc-4b5b-90f7-4c8c9ebdb5f7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:52.203015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36738409-24bc-4b5b-90f7-4c8c9ebdb5f7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:52.203895 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36738409-24bc-4b5b-90f7-4c8c9ebdb5f7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:52.204331 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36738409-24bc-4b5b-90f7-4c8c9ebdb5f7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:52.268472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:52.347096 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-36738409-24bc-4b5b-90f7-4c8c9ebdb5f7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:52.355277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-36738409-24bc-4b5b-90f7-4c8c9ebdb5f7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.165141 Aug 18 11:06:52.355859 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 265/516] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:52 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:52.689919 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:52.690677 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=10 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:52.694956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-bd3c4832-8c85-4dc2-b495-655f66da2243 req-594ec7d3-defd-4cfb-9f64-18790bc7d481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4d3790-5385-4465-bce8-56ca982c4847", "tag": "c9ccab46-14a6-448e-a1fb-213238710faa"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:52.705580 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-bd3c4832-8c85-4dc2-b495-655f66da2243 req-594ec7d3-defd-4cfb-9f64-18790bc7d481 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:52.706004 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-bd3c4832-8c85-4dc2-b495-655f66da2243 req-594ec7d3-defd-4cfb-9f64-18790bc7d481 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:52.706426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-bd3c4832-8c85-4dc2-b495-655f66da2243 req-594ec7d3-defd-4cfb-9f64-18790bc7d481 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:52.717498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-bd3c4832-8c85-4dc2-b495-655f66da2243 req-594ec7d3-defd-4cfb-9f64-18790bc7d481 service nova] Creating event network-changed:c9ccab46-14a6-448e-a1fb-213238710faa for instance 1f4d3790-5385-4465-bce8-56ca982c4847 on hv-cinder-82660 Aug 18 11:06:52.723381 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-bd3c4832-8c85-4dc2-b495-655f66da2243 req-594ec7d3-defd-4cfb-9f64-18790bc7d481 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034534 Aug 18 11:06:52.723986 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 252/517] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:06:53.380110 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6b0a379f-a7f2-465b-84ec-aa979bb89ad6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:53.381391 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6b0a379f-a7f2-465b-84ec-aa979bb89ad6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:53.388003 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=68 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:53.393933 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b0a379f-a7f2-465b-84ec-aa979bb89ad6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:53.394731 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b0a379f-a7f2-465b-84ec-aa979bb89ad6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:53.395372 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b0a379f-a7f2-465b-84ec-aa979bb89ad6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:53.396926 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b0a379f-a7f2-465b-84ec-aa979bb89ad6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:53.397738 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b0a379f-a7f2-465b-84ec-aa979bb89ad6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:53.399672 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6b0a379f-a7f2-465b-84ec-aa979bb89ad6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:53.571671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6b0a379f-a7f2-465b-84ec-aa979bb89ad6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:53.582325 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6b0a379f-a7f2-465b-84ec-aa979bb89ad6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.209470 Aug 18 11:06:53.583309 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 266/518] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:53 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:54.607318 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-faa9bd86-c79c-4470-aa7b-6eae600d2685 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:54.608009 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-faa9bd86-c79c-4470-aa7b-6eae600d2685 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:54.614140 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-faa9bd86-c79c-4470-aa7b-6eae600d2685 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:54.614615 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-faa9bd86-c79c-4470-aa7b-6eae600d2685 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:54.615042 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-faa9bd86-c79c-4470-aa7b-6eae600d2685 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:54.615724 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-faa9bd86-c79c-4470-aa7b-6eae600d2685 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:54.616168 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-faa9bd86-c79c-4470-aa7b-6eae600d2685 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:54.616583 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-faa9bd86-c79c-4470-aa7b-6eae600d2685 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:54.769656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-faa9bd86-c79c-4470-aa7b-6eae600d2685 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:54.778246 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-faa9bd86-c79c-4470-aa7b-6eae600d2685 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1737 microversion: 2.1 time: 0.175583 Aug 18 11:06:54.778822 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 253/519] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:54 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:55.801325 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9a930380-041d-4065-9b71-17246d3c5ae1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:55.801966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9a930380-041d-4065-9b71-17246d3c5ae1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:55.808556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a930380-041d-4065-9b71-17246d3c5ae1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:55.809042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a930380-041d-4065-9b71-17246d3c5ae1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:55.809480 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a930380-041d-4065-9b71-17246d3c5ae1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:55.810266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a930380-041d-4065-9b71-17246d3c5ae1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:55.810750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a930380-041d-4065-9b71-17246d3c5ae1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:55.811180 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a930380-041d-4065-9b71-17246d3c5ae1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:55.945509 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9a930380-041d-4065-9b71-17246d3c5ae1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:55.953558 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9a930380-041d-4065-9b71-17246d3c5ae1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1717 microversion: 2.1 time: 0.156485 Aug 18 11:06:55.954118 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 267/520] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:55 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:56.062257 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:56.063026 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:56.069988 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:56.070476 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:56.070909 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:56.071625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:56.072086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:56.072516 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:56.160575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] HTTP exception thrown: Cannot 'detach_volume' instance db0e5602-14b6-4ab8-b7b7-0e383adf09be while it is in vm_state rescued Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Request method failure captured: Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: DELETE /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments/c14118f4-7874-4a55-ad1c-f842c7466ec4 HTTP/1.1 Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxam_PDtHLJ-db5zv1qGiOCPbd3HWvSOcxHKrEBJUuzC3C5ATuhSDKsXDjDt3keom5aC4VKFM0yo-U3IE2mEa8cDWLU7B_5Bw9hsBkjmr1uNdMjfzpoIgQRA5wa2VVGVTFWmQFjAgWRd9jH9QKt3AZ88iAfa8bKcQcrFgjEq9EoStU Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: ae09c11177204226a2aa5bb600ee575b Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:06:56.162306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ae09c11177204226a2aa5bb600ee575b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ae09c11177204226a2aa5bb600ee575b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ae09c11177204226a2aa5bb600ee575b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ae09c11177204226a2aa5bb600ee575b"}]}] Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: ae09c11177204226a2aa5bb600ee575b Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-ServerRescueNegativeTestJSON-868309121-project Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 074cfcc7943349a490b29cd4ae3364cb Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-868309121-project Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:06:56.163900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Cannot 'detach_volume' instance db0e5602-14b6-4ab8-b7b7-0e383adf09be while it is in vm_state rescued Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'server_id': 'db0e5602-14b6-4ab8-b7b7-0e383adf09be', 'id': 'c14118f4-7874-4a55-ad1c-f842c7466ec4'} Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance db0e5602-14b6-4ab8-b7b7-0e383adf09be in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:06:56.164807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance db0e5602-14b6-4ab8-b7b7-0e383adf09be while it is in vm_state rescued Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance db0e5602-14b6-4ab8-b7b7-0e383adf09be while it is in vm_state rescued Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:06:56.166263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Returning 409 to user: Cannot 'detach_volume' instance db0e5602-14b6-4ab8-b7b7-0e383adf09be while it is in vm_state rescued {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:06:56.167625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-32bcc8ab-99ff-474c-bc1d-cec6cc19c16a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments/c14118f4-7874-4a55-ad1c-f842c7466ec4" status: 409 len: 152 microversion: 2.1 time: 0.106697 Aug 18 11:06:56.167625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 254/521] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:06:56 2022] DELETE /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments/c14118f4-7874-4a55-ad1c-f842c7466ec4 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:06:56.175309 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c806ed99-40bb-47ea-a35e-6fdf113e0118 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:06:56.175906 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c806ed99-40bb-47ea-a35e-6fdf113e0118 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:56.181834 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c806ed99-40bb-47ea-a35e-6fdf113e0118 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:56.182306 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c806ed99-40bb-47ea-a35e-6fdf113e0118 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:56.182735 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c806ed99-40bb-47ea-a35e-6fdf113e0118 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:56.183415 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c806ed99-40bb-47ea-a35e-6fdf113e0118 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:56.183864 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c806ed99-40bb-47ea-a35e-6fdf113e0118 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:56.184281 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c806ed99-40bb-47ea-a35e-6fdf113e0118 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:56.187941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=100 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:06:56.253194 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c806ed99-40bb-47ea-a35e-6fdf113e0118 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "POST /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/action" status: 202 len: 0 microversion: 2.1 time: 0.081597 Aug 18 11:06:56.254040 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 268/522] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:06:56 2022] POST /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:06:56.262530 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-25ab1a25-fc55-43e6-9cd0-65b4d5e16ff5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:56.263141 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-25ab1a25-fc55-43e6-9cd0-65b4d5e16ff5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:56.273063 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-25ab1a25-fc55-43e6-9cd0-65b4d5e16ff5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:56.273771 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-25ab1a25-fc55-43e6-9cd0-65b4d5e16ff5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:56.274220 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-25ab1a25-fc55-43e6-9cd0-65b4d5e16ff5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:56.274928 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-25ab1a25-fc55-43e6-9cd0-65b4d5e16ff5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:56.275393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-25ab1a25-fc55-43e6-9cd0-65b4d5e16ff5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:56.275825 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-25ab1a25-fc55-43e6-9cd0-65b4d5e16ff5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:56.498688 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-25ab1a25-fc55-43e6-9cd0-65b4d5e16ff5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:56.507229 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-25ab1a25-fc55-43e6-9cd0-65b4d5e16ff5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1725 microversion: 2.1 time: 0.248517 Aug 18 11:06:56.507803 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 255/523] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:56 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:57.529712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1cf40552-3793-4ff4-9006-bd41076f2c9c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:57.530416 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1cf40552-3793-4ff4-9006-bd41076f2c9c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:57.537332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1cf40552-3793-4ff4-9006-bd41076f2c9c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:57.537850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1cf40552-3793-4ff4-9006-bd41076f2c9c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:57.538298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1cf40552-3793-4ff4-9006-bd41076f2c9c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:57.538996 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1cf40552-3793-4ff4-9006-bd41076f2c9c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:57.539462 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1cf40552-3793-4ff4-9006-bd41076f2c9c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:57.539891 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1cf40552-3793-4ff4-9006-bd41076f2c9c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:57.670933 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1cf40552-3793-4ff4-9006-bd41076f2c9c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:57.679968 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1cf40552-3793-4ff4-9006-bd41076f2c9c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1725 microversion: 2.1 time: 0.155013 Aug 18 11:06:57.680539 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 269/524] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:57 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:58.702311 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c4d0ccd4-ea85-42de-9db5-80f5e61ba4ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:58.703461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c4d0ccd4-ea85-42de-9db5-80f5e61ba4ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:58.710387 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c4d0ccd4-ea85-42de-9db5-80f5e61ba4ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:58.710867 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c4d0ccd4-ea85-42de-9db5-80f5e61ba4ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:58.711295 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c4d0ccd4-ea85-42de-9db5-80f5e61ba4ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:58.711980 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c4d0ccd4-ea85-42de-9db5-80f5e61ba4ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:58.712423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c4d0ccd4-ea85-42de-9db5-80f5e61ba4ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:58.712840 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c4d0ccd4-ea85-42de-9db5-80f5e61ba4ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:58.852495 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c4d0ccd4-ea85-42de-9db5-80f5e61ba4ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:06:58.860681 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c4d0ccd4-ea85-42de-9db5-80f5e61ba4ec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1725 microversion: 2.1 time: 0.162178 Aug 18 11:06:58.861247 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 256/525] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:58 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:06:59.882412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-77508e25-0a5b-42c0-a5a4-a999e66d1bb9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:06:59.883028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-77508e25-0a5b-42c0-a5a4-a999e66d1bb9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:06:59.889667 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-77508e25-0a5b-42c0-a5a4-a999e66d1bb9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:59.890159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-77508e25-0a5b-42c0-a5a4-a999e66d1bb9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:59.890811 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-77508e25-0a5b-42c0-a5a4-a999e66d1bb9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:06:59.891605 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-77508e25-0a5b-42c0-a5a4-a999e66d1bb9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:06:59.892062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-77508e25-0a5b-42c0-a5a4-a999e66d1bb9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:06:59.892496 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-77508e25-0a5b-42c0-a5a4-a999e66d1bb9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:00.034036 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-77508e25-0a5b-42c0-a5a4-a999e66d1bb9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:00.042657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-77508e25-0a5b-42c0-a5a4-a999e66d1bb9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1731 microversion: 2.1 time: 0.163978 Aug 18 11:07:00.043217 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 270/526] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:06:59 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:00.065272 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2b608d34-2c8a-4e03-9d6e-5f3a002a5c4b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:00.065875 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2b608d34-2c8a-4e03-9d6e-5f3a002a5c4b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:00.072810 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b608d34-2c8a-4e03-9d6e-5f3a002a5c4b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:00.073303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b608d34-2c8a-4e03-9d6e-5f3a002a5c4b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:00.073778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b608d34-2c8a-4e03-9d6e-5f3a002a5c4b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:00.074479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b608d34-2c8a-4e03-9d6e-5f3a002a5c4b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:00.074933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b608d34-2c8a-4e03-9d6e-5f3a002a5c4b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:00.075362 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2b608d34-2c8a-4e03-9d6e-5f3a002a5c4b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:00.151707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2b608d34-2c8a-4e03-9d6e-5f3a002a5c4b tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091478 Aug 18 11:07:00.152302 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 257/527] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Aug 18 11:07:00 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:01.283297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-0251ae06-a2d1-4dfb-a047-6974003e55ba req-140696d2-01f5-4f2f-8d8a-891a53918b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0e5602-14b6-4ab8-b7b7-0e383adf09be", "tag": "f139b73f-bdbe-4491-9b26-2e2bb5aa8136"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:01.294107 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0251ae06-a2d1-4dfb-a047-6974003e55ba req-140696d2-01f5-4f2f-8d8a-891a53918b81 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:01.294695 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0251ae06-a2d1-4dfb-a047-6974003e55ba req-140696d2-01f5-4f2f-8d8a-891a53918b81 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:01.295207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0251ae06-a2d1-4dfb-a047-6974003e55ba req-140696d2-01f5-4f2f-8d8a-891a53918b81 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:01.313159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-0251ae06-a2d1-4dfb-a047-6974003e55ba req-140696d2-01f5-4f2f-8d8a-891a53918b81 service nova] Creating event network-changed:f139b73f-bdbe-4491-9b26-2e2bb5aa8136 for instance db0e5602-14b6-4ab8-b7b7-0e383adf09be on hv-cinder-82660 Aug 18 11:07:01.318147 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-0251ae06-a2d1-4dfb-a047-6974003e55ba req-140696d2-01f5-4f2f-8d8a-891a53918b81 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039119 Aug 18 11:07:01.318750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 271/528] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:07:03.333350 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-12b165cd-4df8-4b29-b3db-38b856feaf62 req-6e410782-f32f-433a-84d4-7db2232869ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0e5602-14b6-4ab8-b7b7-0e383adf09be", "tag": "f139b73f-bdbe-4491-9b26-2e2bb5aa8136"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:03.342721 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-12b165cd-4df8-4b29-b3db-38b856feaf62 req-6e410782-f32f-433a-84d4-7db2232869ee service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:03.343189 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-12b165cd-4df8-4b29-b3db-38b856feaf62 req-6e410782-f32f-433a-84d4-7db2232869ee service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:03.344119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-12b165cd-4df8-4b29-b3db-38b856feaf62 req-6e410782-f32f-433a-84d4-7db2232869ee service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:03.354907 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-12b165cd-4df8-4b29-b3db-38b856feaf62 req-6e410782-f32f-433a-84d4-7db2232869ee service nova] Creating event network-changed:f139b73f-bdbe-4491-9b26-2e2bb5aa8136 for instance db0e5602-14b6-4ab8-b7b7-0e383adf09be on hv-cinder-82660 Aug 18 11:07:03.360580 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-12b165cd-4df8-4b29-b3db-38b856feaf62 req-6e410782-f32f-433a-84d4-7db2232869ee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031518 Aug 18 11:07:03.361350 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 258/529] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:18.160691 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=11 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:18.161429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:18.165781 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-404ebce7-536d-4a29-959c-25e3627b86e5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:18.166358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-404ebce7-536d-4a29-959c-25e3627b86e5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:18.174977 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-404ebce7-536d-4a29-959c-25e3627b86e5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:18.175476 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-404ebce7-536d-4a29-959c-25e3627b86e5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:18.175966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-404ebce7-536d-4a29-959c-25e3627b86e5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:18.176682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-404ebce7-536d-4a29-959c-25e3627b86e5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:18.177144 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-404ebce7-536d-4a29-959c-25e3627b86e5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:18.177685 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-404ebce7-536d-4a29-959c-25e3627b86e5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:18.213397 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-404ebce7-536d-4a29-959c-25e3627b86e5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-volume_attachments/11bac33a-ddd1-4664-8dc1-d3186f38e4ca" status: 200 len: 194 microversion: 2.20 time: 0.054282 Aug 18 11:07:18.214062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 272/530] 10.222.0.15 () {60 vars in 1454 bytes} [Thu Aug 18 11:07:18 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-volume_attachments/11bac33a-ddd1-4664-8dc1-d3186f38e4ca => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:07:18.285709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ae6fe51b-f114-4e28-bd06-01b56d1b0356 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:18.286295 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ae6fe51b-f114-4e28-bd06-01b56d1b0356 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:18.288598 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:18.289249 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=60 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:18.297394 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ae6fe51b-f114-4e28-bd06-01b56d1b0356 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:18.298163 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ae6fe51b-f114-4e28-bd06-01b56d1b0356 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:18.298617 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ae6fe51b-f114-4e28-bd06-01b56d1b0356 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:18.299344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ae6fe51b-f114-4e28-bd06-01b56d1b0356 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:18.299804 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ae6fe51b-f114-4e28-bd06-01b56d1b0356 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:18.300234 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ae6fe51b-f114-4e28-bd06-01b56d1b0356 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:18.383702 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-ae6fe51b-f114-4e28-bd06-01b56d1b0356 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lazy-loading 'services' on Instance uuid e210ba46-e81e-4939-b202-4b569f906d8b {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:07:18.458672 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ae6fe51b-f114-4e28-bd06-01b56d1b0356 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-volume_attachments/11bac33a-ddd1-4664-8dc1-d3186f38e4ca" status: 202 len: 0 microversion: 2.20 time: 0.178077 Aug 18 11:07:18.459320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 259/531] 10.222.0.15 () {60 vars in 1457 bytes} [Thu Aug 18 11:07:18 2022] DELETE /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-volume_attachments/11bac33a-ddd1-4664-8dc1-d3186f38e4ca => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:07:18.467890 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b17de052-9e91-4c23-bdd7-4f630deb9790 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:18.471657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b17de052-9e91-4c23-bdd7-4f630deb9790 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:18.482140 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b17de052-9e91-4c23-bdd7-4f630deb9790 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:18.482547 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b17de052-9e91-4c23-bdd7-4f630deb9790 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:18.482986 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b17de052-9e91-4c23-bdd7-4f630deb9790 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:18.485219 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b17de052-9e91-4c23-bdd7-4f630deb9790 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:18.486094 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b17de052-9e91-4c23-bdd7-4f630deb9790 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:18.486511 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b17de052-9e91-4c23-bdd7-4f630deb9790 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:18.518757 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b17de052-9e91-4c23-bdd7-4f630deb9790 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054739 Aug 18 11:07:18.519547 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 273/532] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Aug 18 11:07:18 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:07:19.532606 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9e647431-0ea6-4009-b787-f9829d67bcd9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:19.534864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9e647431-0ea6-4009-b787-f9829d67bcd9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:19.541495 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9e647431-0ea6-4009-b787-f9829d67bcd9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:19.542010 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9e647431-0ea6-4009-b787-f9829d67bcd9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:19.542706 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9e647431-0ea6-4009-b787-f9829d67bcd9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:19.543399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9e647431-0ea6-4009-b787-f9829d67bcd9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:19.543860 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9e647431-0ea6-4009-b787-f9829d67bcd9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:19.544291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9e647431-0ea6-4009-b787-f9829d67bcd9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:19.575628 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9e647431-0ea6-4009-b787-f9829d67bcd9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047896 Aug 18 11:07:19.576194 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 260/533] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Aug 18 11:07:19 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:19.638785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5b0ba677-4b33-407f-a989-562d19f0aee6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:19.639329 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5b0ba677-4b33-407f-a989-562d19f0aee6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:19.646297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5b0ba677-4b33-407f-a989-562d19f0aee6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:19.646836 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5b0ba677-4b33-407f-a989-562d19f0aee6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:19.647273 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5b0ba677-4b33-407f-a989-562d19f0aee6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:19.647998 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5b0ba677-4b33-407f-a989-562d19f0aee6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:19.648450 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5b0ba677-4b33-407f-a989-562d19f0aee6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:19.648876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5b0ba677-4b33-407f-a989-562d19f0aee6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:19.675358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5b0ba677-4b33-407f-a989-562d19f0aee6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Going to try to terminate instance {{(pid=120800) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:07:19.760588 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5b0ba677-4b33-407f-a989-562d19f0aee6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 204 len: 0 microversion: 2.20 time: 0.125332 Aug 18 11:07:19.761432 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 274/534] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Aug 18 11:07:19 2022] DELETE /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:07:19.769705 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:19.770313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:19.776235 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:19.776722 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:19.777161 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:19.777880 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:19.778379 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:19.778808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:19.915346 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:19.925975 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:19.927505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:19.928666 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-62c91cc7-c21b-468e-8403-2989d4568d77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.163116 Aug 18 11:07:19.929223 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 261/535] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:19 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:20.953228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:20.954025 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:20.960737 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:20.961234 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:20.961803 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:20.962428 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:20.962882 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:20.963327 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:21.098032 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:21.107158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:21.109277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:21.110650 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-dbf228f8-4834-4d3f-9f73-89a77eb75180 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1724 microversion: 2.20 time: 0.162148 Aug 18 11:07:21.111211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 275/536] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:20 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:22.135411 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:22.135984 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:22.143210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:22.143696 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:22.144131 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:22.144858 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:22.145317 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:22.145795 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:22.229459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:22.237909 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:22.239426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:22.240587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-33ce2d5c-e153-4959-8e5e-924126e690f6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 200 len: 1657 microversion: 2.20 time: 0.109388 Aug 18 11:07:22.241353 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 262/537] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:22 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 1657 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:22.350993 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-4c6747d5-c0cf-4483-800b-8330ac980e44 req-a4b70648-6cbe-4b1d-98a6-ce6a1b8bbfae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e210ba46-e81e-4939-b202-4b569f906d8b", "name": "network-vif-deleted", "tag": "850023d2-3a9f-4c57-85af-2b31e7f7b114"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:22.364539 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-4c6747d5-c0cf-4483-800b-8330ac980e44 req-a4b70648-6cbe-4b1d-98a6-ce6a1b8bbfae service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:22.365016 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-4c6747d5-c0cf-4483-800b-8330ac980e44 req-a4b70648-6cbe-4b1d-98a6-ce6a1b8bbfae service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:22.365445 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-4c6747d5-c0cf-4483-800b-8330ac980e44 req-a4b70648-6cbe-4b1d-98a6-ce6a1b8bbfae service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:22.384982 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-4c6747d5-c0cf-4483-800b-8330ac980e44 req-a4b70648-6cbe-4b1d-98a6-ce6a1b8bbfae service nova] Creating event network-vif-deleted:850023d2-3a9f-4c57-85af-2b31e7f7b114 for instance e210ba46-e81e-4939-b202-4b569f906d8b on hv-cinder-82660 Aug 18 11:07:22.391089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-4c6747d5-c0cf-4483-800b-8330ac980e44 req-a4b70648-6cbe-4b1d-98a6-ce6a1b8bbfae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042669 Aug 18 11:07:22.394716 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 276/538] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:23.265148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:23.265971 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:23.272585 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:23.273194 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:23.273654 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:23.274351 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:23.275050 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:23.275475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:23.289909 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] HTTP exception thrown: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Request method failure captured: Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b HTTP/1.1 Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxdIayRbamyRfEfP6BbM36tvM44lJ8H11GyaA5HvxPwGgrQHsdE9Px98wZ94MoCNuKRtDk_v20CDunzRUKyv6uGYk71E563PMPl77DVjcEO1aj0uPChKHogPwamHFQybAd_urF2URK5o72HxpCfWjiZw5_kzEDLzeMYb61P0-Sn0OM Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:07:23.291604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c723b1181c94699b389f0fc03e19af6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c723b1181c94699b389f0fc03e19af6"}]}] Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 7dc5501d59fb4593b405f0e9bd2e49ef Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:07:23.293684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'e210ba46-e81e-4939-b202-4b569f906d8b'} Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:07:23.294610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:07:23.297245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:23.299141 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Returning 404 to user: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:07:23.299141 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-722136b7-6a0f-44d4-8d45-390447b7e46e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 404 len: 111 microversion: 2.20 time: 0.032242 Aug 18 11:07:23.299141 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 263/539] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:23 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:07:23.304042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9d66e8c6-886f-4342-8330-f61cee7995c0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '.version_select at 0x7f7ec8bc1550>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:23.325163 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9d66e8c6-886f-4342-8330-f61cee7995c0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621352910" status: 204 len: 0 microversion: 2.20 time: 0.025306 Aug 18 11:07:23.325785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 277/540] 10.222.0.15 () {60 vars in 1262 bytes} [Thu Aug 18 11:07:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621352910 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:07:23.982135 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-df7c01dc-5b43-48a2-9262-c14bdb21bd48 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Action: 'create', calling method: .version_select at 0x7f7ec8acb9d0>, body: {"keypair": {"name": "tempest-keypair-806743886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN01Zi6wvbdENsDoYjUVzdUh8r6C21u3jZVbvo00nJVq1s/bYxZMejWfl8BL5awStZFPEw0jE9VrrjydxEUmZFpDR3AnnIY6agoRzwuRTTtOsPMH48dGwuvg3SLE4+yasA=="}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:23.998254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-df7c01dc-5b43-48a2-9262-c14bdb21bd48 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Getting quotas for project 3c723b1181c94699b389f0fc03e19af6. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:07:24.002050 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-df7c01dc-5b43-48a2-9262-c14bdb21bd48 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Getting quotas for user 7dc5501d59fb4593b405f0e9bd2e49ef and project 3c723b1181c94699b389f0fc03e19af6. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:07:24.025178 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-df7c01dc-5b43-48a2-9262-c14bdb21bd48 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047318 Aug 18 11:07:24.025801 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 264/541] 10.222.0.15 () {62 vars in 1200 bytes} [Thu Aug 18 11:07:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 11:07:25.354300 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1931608851", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb9079f2-48dc-4905-914c-07a7ceac168a"}], "security_groups": [{"name": "tempest-securitygroup--1429889846"}], "key_name": "tempest-keypair-806743886", "user_data": "}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:25.460564 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.network.neutron [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] validate_networks() for [('bb9079f2-48dc-4905-914c-07a7ceac168a', None, None, None, None, None)] {{(pid=120800) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:07:25.845537 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Flavor limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:07:25.845969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Image limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:07:25.846437 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Flavor pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:07:25.846840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Image pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:07:25.847257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:07:25.855854 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:25.856408 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:25.856839 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:25.857647 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:25.858102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:25.858745 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:25.875888 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Getting quotas for project 3c723b1181c94699b389f0fc03e19af6. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:07:25.879791 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Getting quotas for user 7dc5501d59fb4593b405f0e9bd2e49ef and project 3c723b1181c94699b389f0fc03e19af6. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:07:25.891385 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Going to run 1 instances... {{(pid=120800) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:07:25.893720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:07:25.941639 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2a5e4a2a-2ee6-47a2-b3af-f52e7f308e3f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.592643 Aug 18 11:07:25.942603 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 278/542] 10.222.0.15 () {62 vars in 1188 bytes} [Thu Aug 18 11:07:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:07:25.954387 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-81c9b1a4-9b57-4f1f-b2d6-a70ea447f008 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:25.955114 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-81c9b1a4-9b57-4f1f-b2d6-a70ea447f008 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:26.010793 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-81c9b1a4-9b57-4f1f-b2d6-a70ea447f008 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:26.018757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-81c9b1a4-9b57-4f1f-b2d6-a70ea447f008 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:26.020264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-81c9b1a4-9b57-4f1f-b2d6-a70ea447f008 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:26.021363 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-81c9b1a4-9b57-4f1f-b2d6-a70ea447f008 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1281 microversion: 2.20 time: 0.072094 Aug 18 11:07:26.021945 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 265/543] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:25 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:27.045326 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:27.046758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:27.054493 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:27.055068 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:27.055611 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:27.056400 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:27.057091 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:27.057619 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:27.131798 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:27.140636 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:27.142131 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:27.143248 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4bc9db9b-b78f-4f5b-bd64-27e8bc890b04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1339 microversion: 2.20 time: 0.103196 Aug 18 11:07:27.143809 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 279/544] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:27 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:28.167200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:28.168061 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:28.174760 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:28.175247 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:28.175703 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:28.176401 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:28.176889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:28.177283 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:28.428551 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:28.438505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:28.440075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:28.441213 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5a4dc091-c1a0-4032-b466-567998ae3a04 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1407 microversion: 2.20 time: 0.277932 Aug 18 11:07:28.441826 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 266/545] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:28 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:28.580550 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-e9441b3f-3c53-404e-9deb-d3806c4c06a5 req-a71cfa8e-0c04-4361-8d7a-b447e739f489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5aa4f6f-cb29-46ab-b558-e91195e757fc", "tag": "b6d81a7c-88f7-44ae-a304-da843f87fdd7"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:28.590751 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-e9441b3f-3c53-404e-9deb-d3806c4c06a5 req-a71cfa8e-0c04-4361-8d7a-b447e739f489 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:28.591246 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-e9441b3f-3c53-404e-9deb-d3806c4c06a5 req-a71cfa8e-0c04-4361-8d7a-b447e739f489 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:28.591890 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-e9441b3f-3c53-404e-9deb-d3806c4c06a5 req-a71cfa8e-0c04-4361-8d7a-b447e739f489 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:28.604319 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-e9441b3f-3c53-404e-9deb-d3806c4c06a5 req-a71cfa8e-0c04-4361-8d7a-b447e739f489 service nova] Creating event network-changed:b6d81a7c-88f7-44ae-a304-da843f87fdd7 for instance a5aa4f6f-cb29-46ab-b558-e91195e757fc on hv-cinder-82660 Aug 18 11:07:28.609603 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-e9441b3f-3c53-404e-9deb-d3806c4c06a5 req-a71cfa8e-0c04-4361-8d7a-b447e739f489 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033069 Aug 18 11:07:28.610404 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 280/546] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:28.819007 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9b4178fb-bfa1-4158-8013-b7a4a73723a3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:28.819506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9b4178fb-bfa1-4158-8013-b7a4a73723a3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:28.825337 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b4178fb-bfa1-4158-8013-b7a4a73723a3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:28.825861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b4178fb-bfa1-4158-8013-b7a4a73723a3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:28.826328 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b4178fb-bfa1-4158-8013-b7a4a73723a3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:28.827037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b4178fb-bfa1-4158-8013-b7a4a73723a3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:28.827616 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b4178fb-bfa1-4158-8013-b7a4a73723a3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:28.828342 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b4178fb-bfa1-4158-8013-b7a4a73723a3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:28.852540 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9b4178fb-bfa1-4158-8013-b7a4a73723a3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/ips" status: 200 len: 149 microversion: 2.1 time: 0.037451 Aug 18 11:07:28.853120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 267/547] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Aug 18 11:07:28 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:29.464024 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:29.464640 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:29.472654 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:29.473148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:29.473619 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:29.474330 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:29.474951 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:29.475407 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:29.611470 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:29.620589 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:29.622167 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:29.623266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-efc1594d-214b-4e97-8e8e-d60b7455d928 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1407 microversion: 2.20 time: 0.163671 Aug 18 11:07:29.623823 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 281/548] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:29 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:30.200026 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-95fb6833-2f93-4213-a71b-6865db918348 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:30.202520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-95fb6833-2f93-4213-a71b-6865db918348 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:30.209174 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-95fb6833-2f93-4213-a71b-6865db918348 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:30.209761 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-95fb6833-2f93-4213-a71b-6865db918348 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:30.210195 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-95fb6833-2f93-4213-a71b-6865db918348 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:30.210884 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-95fb6833-2f93-4213-a71b-6865db918348 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:30.211331 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-95fb6833-2f93-4213-a71b-6865db918348 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:30.211932 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-95fb6833-2f93-4213-a71b-6865db918348 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:30.522890 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-95fb6833-2f93-4213-a71b-6865db918348 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326619 Aug 18 11:07:30.523507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 268/549] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:07:30 2022] POST /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:30.647318 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:30.648684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:30.656804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:30.657565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:30.658059 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:30.659456 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:30.659456 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:30.659835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:30.792961 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:30.800980 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:30.802525 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:30.803628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-22b27831-14b6-4b57-95f6-6ebf03a75fad tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1407 microversion: 2.20 time: 0.160525 Aug 18 11:07:30.804184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 282/550] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:30 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:31.827013 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:31.828049 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:31.834252 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:31.834729 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:31.835157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:31.835835 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:31.836275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:31.836691 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:31.968662 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:31.976721 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:31.978385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:31.979493 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-18237185-10ef-4c34-aee5-305470d45b2b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1407 microversion: 2.20 time: 0.157274 Aug 18 11:07:31.980050 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 269/551] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:31 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:32.584280 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-feb6dbd1-78b2-47a7-a34b-99223c0831ee req-aa80b1ec-52f8-48d9-b930-fa24f46cab1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5aa4f6f-cb29-46ab-b558-e91195e757fc", "name": "network-vif-plugged", "status": "completed", "tag": "b6d81a7c-88f7-44ae-a304-da843f87fdd7"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:32.595977 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-feb6dbd1-78b2-47a7-a34b-99223c0831ee req-aa80b1ec-52f8-48d9-b930-fa24f46cab1d service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:32.596459 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-feb6dbd1-78b2-47a7-a34b-99223c0831ee req-aa80b1ec-52f8-48d9-b930-fa24f46cab1d service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:32.597499 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-feb6dbd1-78b2-47a7-a34b-99223c0831ee req-aa80b1ec-52f8-48d9-b930-fa24f46cab1d service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:32.608610 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-feb6dbd1-78b2-47a7-a34b-99223c0831ee req-aa80b1ec-52f8-48d9-b930-fa24f46cab1d service nova] Creating event network-vif-plugged:b6d81a7c-88f7-44ae-a304-da843f87fdd7 for instance a5aa4f6f-cb29-46ab-b558-e91195e757fc on hv-cinder-82660 Aug 18 11:07:32.613874 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-feb6dbd1-78b2-47a7-a34b-99223c0831ee req-aa80b1ec-52f8-48d9-b930-fa24f46cab1d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033262 Aug 18 11:07:32.614836 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 283/552] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:33.004055 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:33.004665 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:33.011102 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:33.011589 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:33.012030 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:33.012724 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:33.013179 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:33.013641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:33.148395 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:33.157086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:33.158627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:33.159739 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-bcf38261-32f6-4373-b434-ab265bfb1afb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1407 microversion: 2.20 time: 0.160758 Aug 18 11:07:33.160311 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 270/553] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:32 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:33.822546 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-61b68d5a-5f61-423d-bf87-e3331d31c931 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:33.823116 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-61b68d5a-5f61-423d-bf87-e3331d31c931 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:33.830046 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61b68d5a-5f61-423d-bf87-e3331d31c931 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:33.830548 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61b68d5a-5f61-423d-bf87-e3331d31c931 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:33.830978 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61b68d5a-5f61-423d-bf87-e3331d31c931 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:33.831682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61b68d5a-5f61-423d-bf87-e3331d31c931 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:33.832130 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61b68d5a-5f61-423d-bf87-e3331d31c931 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:33.832568 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61b68d5a-5f61-423d-bf87-e3331d31c931 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:33.952816 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-61b68d5a-5f61-423d-bf87-e3331d31c931 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lazy-loading 'services' on Instance uuid db0e5602-14b6-4ab8-b7b7-0e383adf09be {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:07:34.077330 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-61b68d5a-5f61-423d-bf87-e3331d31c931 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments/c14118f4-7874-4a55-ad1c-f842c7466ec4" status: 202 len: 0 microversion: 2.1 time: 0.258841 Aug 18 11:07:34.077928 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 284/554] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:07:33 2022] DELETE /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments/c14118f4-7874-4a55-ad1c-f842c7466ec4 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:07:34.086861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4b4959e6-542a-4547-a0c5-88319bd47936 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:34.089165 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4b4959e6-542a-4547-a0c5-88319bd47936 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:34.096864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b4959e6-542a-4547-a0c5-88319bd47936 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:34.097351 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b4959e6-542a-4547-a0c5-88319bd47936 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:34.097830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b4959e6-542a-4547-a0c5-88319bd47936 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:34.098528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b4959e6-542a-4547-a0c5-88319bd47936 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:34.098976 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b4959e6-542a-4547-a0c5-88319bd47936 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:34.099401 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4b4959e6-542a-4547-a0c5-88319bd47936 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:34.132531 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4b4959e6-542a-4547-a0c5-88319bd47936 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049639 Aug 18 11:07:34.133084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 271/555] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:07:34 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:34.183700 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:34.184386 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:34.190849 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:34.191319 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:34.191747 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:34.192422 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:34.192873 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:34.193285 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:34.328958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:34.336992 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:34.338590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:34.339734 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3a53db06-3b02-407d-9c56-4a103b0d94c4 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1407 microversion: 2.20 time: 0.160250 Aug 18 11:07:34.340287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 285/556] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:34 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:35.144499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2120e943-c2a9-44f9-b35b-03c2b217a524 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:35.146858 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2120e943-c2a9-44f9-b35b-03c2b217a524 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:35.153274 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2120e943-c2a9-44f9-b35b-03c2b217a524 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:35.153792 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2120e943-c2a9-44f9-b35b-03c2b217a524 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:35.154231 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2120e943-c2a9-44f9-b35b-03c2b217a524 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:35.154914 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2120e943-c2a9-44f9-b35b-03c2b217a524 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:35.155470 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2120e943-c2a9-44f9-b35b-03c2b217a524 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:35.155976 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2120e943-c2a9-44f9-b35b-03c2b217a524 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:35.189735 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2120e943-c2a9-44f9-b35b-03c2b217a524 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049143 Aug 18 11:07:35.190296 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 272/557] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:07:35 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:35.363280 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:35.363884 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:35.370319 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:35.370810 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:35.371234 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:35.371931 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:35.372412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:35.372838 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:35.512604 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:35.521223 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:35.522751 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:35.523904 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-26f21d2d-2afc-41ba-a103-8c18fb887e02 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1599 microversion: 2.20 time: 0.164521 Aug 18 11:07:35.524456 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 286/558] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:07:35 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:07:35.549997 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-725fe99d-d357-46cf-aa72-7ec431ebe1c2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:35.550521 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-725fe99d-d357-46cf-aa72-7ec431ebe1c2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:35.556504 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-725fe99d-d357-46cf-aa72-7ec431ebe1c2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:35.556989 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-725fe99d-d357-46cf-aa72-7ec431ebe1c2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:35.557427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-725fe99d-d357-46cf-aa72-7ec431ebe1c2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:35.558144 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-725fe99d-d357-46cf-aa72-7ec431ebe1c2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:35.558603 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-725fe99d-d357-46cf-aa72-7ec431ebe1c2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:35.559028 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-725fe99d-d357-46cf-aa72-7ec431ebe1c2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:35.638015 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-725fe99d-d357-46cf-aa72-7ec431ebe1c2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092676 Aug 18 11:07:35.638592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 273/559] 10.222.0.15 () {60 vars in 1316 bytes} [Thu Aug 18 11:07:35 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:07:36.202368 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-18b9f4aa-77c5-4190-a152-7cc8d28ae4e7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:36.204996 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-18b9f4aa-77c5-4190-a152-7cc8d28ae4e7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:36.207401 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:36.208178 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=6 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:36.214042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-18b9f4aa-77c5-4190-a152-7cc8d28ae4e7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:36.214535 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-18b9f4aa-77c5-4190-a152-7cc8d28ae4e7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:36.214972 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-18b9f4aa-77c5-4190-a152-7cc8d28ae4e7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:36.216261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-18b9f4aa-77c5-4190-a152-7cc8d28ae4e7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:36.216261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-18b9f4aa-77c5-4190-a152-7cc8d28ae4e7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:36.216539 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-18b9f4aa-77c5-4190-a152-7cc8d28ae4e7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:36.247986 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-18b9f4aa-77c5-4190-a152-7cc8d28ae4e7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049683 Aug 18 11:07:36.248542 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 287/560] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:07:36 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:36.611350 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=6 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:36.615740 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-13a927dc-dcf4-4c5b-8428-820b6893fdac req-5eb26701-7c59-4c71-b961-9806816071a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5aa4f6f-cb29-46ab-b558-e91195e757fc", "tag": "b6d81a7c-88f7-44ae-a304-da843f87fdd7"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:36.627281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-13a927dc-dcf4-4c5b-8428-820b6893fdac req-5eb26701-7c59-4c71-b961-9806816071a5 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:36.627769 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-13a927dc-dcf4-4c5b-8428-820b6893fdac req-5eb26701-7c59-4c71-b961-9806816071a5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:36.628200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-13a927dc-dcf4-4c5b-8428-820b6893fdac req-5eb26701-7c59-4c71-b961-9806816071a5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:36.640376 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-13a927dc-dcf4-4c5b-8428-820b6893fdac req-5eb26701-7c59-4c71-b961-9806816071a5 service nova] Creating event network-changed:b6d81a7c-88f7-44ae-a304-da843f87fdd7 for instance a5aa4f6f-cb29-46ab-b558-e91195e757fc on hv-cinder-82660 Aug 18 11:07:36.646150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-13a927dc-dcf4-4c5b-8428-820b6893fdac req-5eb26701-7c59-4c71-b961-9806816071a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035384 Aug 18 11:07:36.646756 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 274/561] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:37.261231 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c9c2196e-e897-4209-a794-734e23a0a8a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:37.264460 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c9c2196e-e897-4209-a794-734e23a0a8a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:37.272394 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c9c2196e-e897-4209-a794-734e23a0a8a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:37.273114 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c9c2196e-e897-4209-a794-734e23a0a8a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:37.273880 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c9c2196e-e897-4209-a794-734e23a0a8a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:37.274840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c9c2196e-e897-4209-a794-734e23a0a8a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:37.275559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c9c2196e-e897-4209-a794-734e23a0a8a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:37.276331 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c9c2196e-e897-4209-a794-734e23a0a8a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:37.314784 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c9c2196e-e897-4209-a794-734e23a0a8a9 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057378 Aug 18 11:07:37.315409 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 288/562] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:07:37 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:38.078178 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:38.080496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:38.086617 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.087102 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.087535 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.088220 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.088671 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.089095 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.168243 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Invalid volume: volume 9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8 is already attached to instances: 1f4d3790-5385-4465-bce8-56ca982c4847 Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: POST /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments HTTP/1.1 Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 74 Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:07:38.169995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {"volumeAttachment": {"volumeId": "9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8"}} Aug 18 11:07:38.172201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Invalid volume: volume 9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8 is already attached to instances: 1f4d3790-5385-4465-bce8-56ca982c4847 Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'server_id': '1f4d3790-5385-4465-bce8-56ca982c4847', 'body': {'volumeAttachment': {'volumeId': '9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8'}}} Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8 is already attached to instances: 1f4d3790-5385-4465-bce8-56ca982c4847 Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:38.173084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8 is already attached to instances: 1f4d3790-5385-4465-bce8-56ca982c4847 Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:38.174506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:38.175851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:38.175851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:07:38.175851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:07:38.175851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8 is already attached to instances: 1f4d3790-5385-4465-bce8-56ca982c4847 Aug 18 11:07:38.175851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:38.175851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 400 to user: Invalid volume: volume 9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8 is already attached to instances: 1f4d3790-5385-4465-bce8-56ca982c4847 {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:07:38.175851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-72e61875-973d-431e-a857-31e1566d7ce6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099003 Aug 18 11:07:38.175851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 275/563] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:07:38 2022] POST /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 11:07:38.237027 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-98e55299-6dd6-4549-ab24-3f8f9ed59f4e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:38.237504 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-98e55299-6dd6-4549-ab24-3f8f9ed59f4e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:38.243442 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-98e55299-6dd6-4549-ab24-3f8f9ed59f4e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.243920 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-98e55299-6dd6-4549-ab24-3f8f9ed59f4e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.244358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-98e55299-6dd6-4549-ab24-3f8f9ed59f4e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.245041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-98e55299-6dd6-4549-ab24-3f8f9ed59f4e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.245492 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-98e55299-6dd6-4549-ab24-3f8f9ed59f4e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.245934 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-98e55299-6dd6-4549-ab24-3f8f9ed59f4e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.326843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b4a6f8a8-9795-400f-a9b3-2bdcfd9d6ef5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:38.329869 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b4a6f8a8-9795-400f-a9b3-2bdcfd9d6ef5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:38.335888 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4a6f8a8-9795-400f-a9b3-2bdcfd9d6ef5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.336373 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4a6f8a8-9795-400f-a9b3-2bdcfd9d6ef5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.336812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4a6f8a8-9795-400f-a9b3-2bdcfd9d6ef5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.337511 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4a6f8a8-9795-400f-a9b3-2bdcfd9d6ef5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.337990 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4a6f8a8-9795-400f-a9b3-2bdcfd9d6ef5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.338418 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b4a6f8a8-9795-400f-a9b3-2bdcfd9d6ef5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.370282 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b4a6f8a8-9795-400f-a9b3-2bdcfd9d6ef5 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047360 Aug 18 11:07:38.370855 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 276/564] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:07:38 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:07:38.434818 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:38.439479 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-98e55299-6dd6-4549-ab24-3f8f9ed59f4e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lazy-loading 'services' on Instance uuid 1f4d3790-5385-4465-bce8-56ca982c4847 {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:07:38.447222 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-223d014b-d1ea-4073-bd9e-0cb4d2cf55cc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:38.447728 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-223d014b-d1ea-4073-bd9e-0cb4d2cf55cc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:38.454747 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-223d014b-d1ea-4073-bd9e-0cb4d2cf55cc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.455241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-223d014b-d1ea-4073-bd9e-0cb4d2cf55cc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.455684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-223d014b-d1ea-4073-bd9e-0cb4d2cf55cc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.456413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-223d014b-d1ea-4073-bd9e-0cb4d2cf55cc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.456874 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-223d014b-d1ea-4073-bd9e-0cb4d2cf55cc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.457304 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-223d014b-d1ea-4073-bd9e-0cb4d2cf55cc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.477507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:38.487388 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-223d014b-d1ea-4073-bd9e-0cb4d2cf55cc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:07:38.520972 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-98e55299-6dd6-4549-ab24-3f8f9ed59f4e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments/9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8" status: 202 len: 0 microversion: 2.1 time: 0.287992 Aug 18 11:07:38.521841 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 289/565] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:07:38 2022] DELETE /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments/9b8add12-ffc3-4458-9f2d-0fec3f1bc5f8 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:07:38.531752 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0f897271-8f60-48d4-b188-81fd2ffeb24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:38.535201 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0f897271-8f60-48d4-b188-81fd2ffeb24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:38.544112 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f897271-8f60-48d4-b188-81fd2ffeb24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.544620 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f897271-8f60-48d4-b188-81fd2ffeb24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.545128 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f897271-8f60-48d4-b188-81fd2ffeb24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.545979 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f897271-8f60-48d4-b188-81fd2ffeb24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.547212 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f897271-8f60-48d4-b188-81fd2ffeb24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.547591 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f897271-8f60-48d4-b188-81fd2ffeb24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.572726 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-223d014b-d1ea-4073-bd9e-0cb4d2cf55cc tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 204 len: 0 microversion: 2.1 time: 0.129998 Aug 18 11:07:38.576591 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 277/566] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:07:38 2022] DELETE /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:07:38.582608 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ea0d1e20-1988-464f-bbeb-1d1b0d204719 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:38.583314 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ea0d1e20-1988-464f-bbeb-1d1b0d204719 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:38.584785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0f897271-8f60-48d4-b188-81fd2ffeb24e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058237 Aug 18 11:07:38.589607 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 290/567] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:07:38 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:38.589768 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ea0d1e20-1988-464f-bbeb-1d1b0d204719 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.589768 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ea0d1e20-1988-464f-bbeb-1d1b0d204719 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.590136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ea0d1e20-1988-464f-bbeb-1d1b0d204719 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.590836 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ea0d1e20-1988-464f-bbeb-1d1b0d204719 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:38.591292 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ea0d1e20-1988-464f-bbeb-1d1b0d204719 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:38.591722 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ea0d1e20-1988-464f-bbeb-1d1b0d204719 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:38.775140 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ea0d1e20-1988-464f-bbeb-1d1b0d204719 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:38.783344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ea0d1e20-1988-464f-bbeb-1d1b0d204719 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1691 microversion: 2.1 time: 0.204931 Aug 18 11:07:38.783948 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 278/568] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:38 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:39.597983 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d6212f64-0423-468b-b29d-d17dc926fe32 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:39.600107 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d6212f64-0423-468b-b29d-d17dc926fe32 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:39.606576 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6212f64-0423-468b-b29d-d17dc926fe32 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:39.607060 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6212f64-0423-468b-b29d-d17dc926fe32 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:39.607496 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6212f64-0423-468b-b29d-d17dc926fe32 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:39.608184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6212f64-0423-468b-b29d-d17dc926fe32 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:39.608831 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6212f64-0423-468b-b29d-d17dc926fe32 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:39.609452 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6212f64-0423-468b-b29d-d17dc926fe32 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:39.638374 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-d6212f64-0423-468b-b29d-d17dc926fe32 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044262 Aug 18 11:07:39.638931 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 291/569] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:07:39 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:39.804582 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6c8f4f11-9ec9-47f8-8699-586dc695f622 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:39.805190 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6c8f4f11-9ec9-47f8-8699-586dc695f622 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:39.812732 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c8f4f11-9ec9-47f8-8699-586dc695f622 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:39.813208 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c8f4f11-9ec9-47f8-8699-586dc695f622 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:39.813683 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c8f4f11-9ec9-47f8-8699-586dc695f622 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:39.814371 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c8f4f11-9ec9-47f8-8699-586dc695f622 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:39.814824 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c8f4f11-9ec9-47f8-8699-586dc695f622 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:39.815246 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6c8f4f11-9ec9-47f8-8699-586dc695f622 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:39.950636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6c8f4f11-9ec9-47f8-8699-586dc695f622 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:39.959239 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6c8f4f11-9ec9-47f8-8699-586dc695f622 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1691 microversion: 2.1 time: 0.158432 Aug 18 11:07:39.959816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 279/570] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:39 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:40.650402 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-88948ccf-03eb-4e6c-9b44-cb31f4b31b10 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:40.652874 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-88948ccf-03eb-4e6c-9b44-cb31f4b31b10 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:40.659792 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88948ccf-03eb-4e6c-9b44-cb31f4b31b10 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:40.660295 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88948ccf-03eb-4e6c-9b44-cb31f4b31b10 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:40.660733 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88948ccf-03eb-4e6c-9b44-cb31f4b31b10 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:40.661435 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88948ccf-03eb-4e6c-9b44-cb31f4b31b10 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:40.661921 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88948ccf-03eb-4e6c-9b44-cb31f4b31b10 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:40.662349 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-88948ccf-03eb-4e6c-9b44-cb31f4b31b10 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:40.694826 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-88948ccf-03eb-4e6c-9b44-cb31f4b31b10 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048289 Aug 18 11:07:40.695381 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 292/571] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:07:40 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:40.980137 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6e85d65e-240a-48f5-94ba-328826dddcec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:40.980738 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6e85d65e-240a-48f5-94ba-328826dddcec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:40.987797 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e85d65e-240a-48f5-94ba-328826dddcec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:40.988275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e85d65e-240a-48f5-94ba-328826dddcec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:40.988705 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e85d65e-240a-48f5-94ba-328826dddcec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:40.989385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e85d65e-240a-48f5-94ba-328826dddcec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:40.989877 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e85d65e-240a-48f5-94ba-328826dddcec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:40.990294 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e85d65e-240a-48f5-94ba-328826dddcec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:41.127440 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6e85d65e-240a-48f5-94ba-328826dddcec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:41.134888 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6e85d65e-240a-48f5-94ba-328826dddcec tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1691 microversion: 2.1 time: 0.158564 Aug 18 11:07:41.135448 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 280/572] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:40 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:41.708322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3c068661-780c-48d6-bd4c-3cdec24c92bc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:41.710492 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3c068661-780c-48d6-bd4c-3cdec24c92bc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:41.716888 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3c068661-780c-48d6-bd4c-3cdec24c92bc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:41.717363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3c068661-780c-48d6-bd4c-3cdec24c92bc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:41.717910 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3c068661-780c-48d6-bd4c-3cdec24c92bc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:41.718598 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3c068661-780c-48d6-bd4c-3cdec24c92bc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:41.719043 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3c068661-780c-48d6-bd4c-3cdec24c92bc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:41.719462 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3c068661-780c-48d6-bd4c-3cdec24c92bc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:41.747748 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3c068661-780c-48d6-bd4c-3cdec24c92bc tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043357 Aug 18 11:07:41.748297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 293/573] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:07:41 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:07:42.156769 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2f53d530-f105-490d-bc90-694ced8f64e6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:42.157488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2f53d530-f105-490d-bc90-694ced8f64e6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:42.163916 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2f53d530-f105-490d-bc90-694ced8f64e6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:42.164708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2f53d530-f105-490d-bc90-694ced8f64e6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:42.165149 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2f53d530-f105-490d-bc90-694ced8f64e6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:42.165873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2f53d530-f105-490d-bc90-694ced8f64e6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:42.166332 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2f53d530-f105-490d-bc90-694ced8f64e6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:42.166761 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2f53d530-f105-490d-bc90-694ced8f64e6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:42.395689 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2f53d530-f105-490d-bc90-694ced8f64e6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:42.403346 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2f53d530-f105-490d-bc90-694ced8f64e6 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1691 microversion: 2.1 time: 0.251042 Aug 18 11:07:42.403921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 281/574] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:42 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1691 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:42.760682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ab7bf64e-bfff-499a-b495-26ad6a286874 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:42.763078 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ab7bf64e-bfff-499a-b495-26ad6a286874 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:42.770518 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ab7bf64e-bfff-499a-b495-26ad6a286874 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:42.771045 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ab7bf64e-bfff-499a-b495-26ad6a286874 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:42.771480 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ab7bf64e-bfff-499a-b495-26ad6a286874 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:42.772193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ab7bf64e-bfff-499a-b495-26ad6a286874 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:42.772645 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ab7bf64e-bfff-499a-b495-26ad6a286874 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:42.773188 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ab7bf64e-bfff-499a-b495-26ad6a286874 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:42.810279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ab7bf64e-bfff-499a-b495-26ad6a286874 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053523 Aug 18 11:07:42.810920 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 294/575] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:07:42 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:07:42.878584 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3733e995-f545-44b7-907f-4d7d840f58af tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:42.879086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3733e995-f545-44b7-907f-4d7d840f58af tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:42.885651 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3733e995-f545-44b7-907f-4d7d840f58af tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:42.886080 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3733e995-f545-44b7-907f-4d7d840f58af tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:42.886521 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3733e995-f545-44b7-907f-4d7d840f58af tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:42.887296 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3733e995-f545-44b7-907f-4d7d840f58af tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:42.887753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3733e995-f545-44b7-907f-4d7d840f58af tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:42.888188 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3733e995-f545-44b7-907f-4d7d840f58af tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:42.921029 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3733e995-f545-44b7-907f-4d7d840f58af tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:07:43.005902 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3733e995-f545-44b7-907f-4d7d840f58af tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 204 len: 0 microversion: 2.1 time: 0.131491 Aug 18 11:07:43.006841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 282/576] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:07:42 2022] DELETE /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:07:43.016008 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-25039d2d-97c4-4300-a9bb-b9bdb6af01b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:43.016854 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-25039d2d-97c4-4300-a9bb-b9bdb6af01b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:43.022832 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-25039d2d-97c4-4300-a9bb-b9bdb6af01b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:43.023397 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-25039d2d-97c4-4300-a9bb-b9bdb6af01b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:43.023888 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-25039d2d-97c4-4300-a9bb-b9bdb6af01b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:43.024639 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-25039d2d-97c4-4300-a9bb-b9bdb6af01b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:43.025267 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-25039d2d-97c4-4300-a9bb-b9bdb6af01b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:43.025729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-25039d2d-97c4-4300-a9bb-b9bdb6af01b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:43.205256 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-25039d2d-97c4-4300-a9bb-b9bdb6af01b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:43.215188 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-25039d2d-97c4-4300-a9bb-b9bdb6af01b6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1681 microversion: 2.1 time: 0.203583 Aug 18 11:07:43.216179 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 295/577] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:43 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:07:43.250408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-4d7b6a18-10ca-4e43-a1c1-5a3a6da869dc req-52366c47-7a46-428d-817f-389b2f0a2acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0e5602-14b6-4ab8-b7b7-0e383adf09be", "name": "network-vif-deleted", "tag": "f139b73f-bdbe-4491-9b26-2e2bb5aa8136"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:43.260437 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4d7b6a18-10ca-4e43-a1c1-5a3a6da869dc req-52366c47-7a46-428d-817f-389b2f0a2acd service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:43.260922 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4d7b6a18-10ca-4e43-a1c1-5a3a6da869dc req-52366c47-7a46-428d-817f-389b2f0a2acd service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:43.261356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4d7b6a18-10ca-4e43-a1c1-5a3a6da869dc req-52366c47-7a46-428d-817f-389b2f0a2acd service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:43.273800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-4d7b6a18-10ca-4e43-a1c1-5a3a6da869dc req-52366c47-7a46-428d-817f-389b2f0a2acd service nova] Creating event network-vif-deleted:f139b73f-bdbe-4491-9b26-2e2bb5aa8136 for instance db0e5602-14b6-4ab8-b7b7-0e383adf09be on hv-cinder-82660 Aug 18 11:07:43.278728 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-4d7b6a18-10ca-4e43-a1c1-5a3a6da869dc req-52366c47-7a46-428d-817f-389b2f0a2acd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033338 Aug 18 11:07:43.279336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 283/578] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:07:43.425169 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-93f5f6c1-af7c-41a4-bff3-caa6cc7a85fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:43.425832 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-93f5f6c1-af7c-41a4-bff3-caa6cc7a85fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:43.431819 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-93f5f6c1-af7c-41a4-bff3-caa6cc7a85fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:43.432299 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-93f5f6c1-af7c-41a4-bff3-caa6cc7a85fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:43.432726 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-93f5f6c1-af7c-41a4-bff3-caa6cc7a85fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:43.433406 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-93f5f6c1-af7c-41a4-bff3-caa6cc7a85fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:43.433882 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-93f5f6c1-af7c-41a4-bff3-caa6cc7a85fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:43.434297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-93f5f6c1-af7c-41a4-bff3-caa6cc7a85fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:43.500451 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-93f5f6c1-af7c-41a4-bff3-caa6cc7a85fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:43.508350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-93f5f6c1-af7c-41a4-bff3-caa6cc7a85fa tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1623 microversion: 2.1 time: 0.087496 Aug 18 11:07:43.509032 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 296/579] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:43 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1623 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:44.238196 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d4f28b63-a343-4382-b598-99a069c5b4cb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:44.239024 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d4f28b63-a343-4382-b598-99a069c5b4cb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:44.246818 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f28b63-a343-4382-b598-99a069c5b4cb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:44.247574 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f28b63-a343-4382-b598-99a069c5b4cb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:44.248010 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f28b63-a343-4382-b598-99a069c5b4cb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:44.248713 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f28b63-a343-4382-b598-99a069c5b4cb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:44.249245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f28b63-a343-4382-b598-99a069c5b4cb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:44.250117 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f28b63-a343-4382-b598-99a069c5b4cb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:44.390394 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d4f28b63-a343-4382-b598-99a069c5b4cb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:44.398395 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d4f28b63-a343-4382-b598-99a069c5b4cb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1681 microversion: 2.1 time: 0.164586 Aug 18 11:07:44.398956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 284/580] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:44 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:44.529288 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:44.529864 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:44.537077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:44.537592 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:44.538031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:44.538724 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:44.539179 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:44.539598 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:44.571212 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:44.571693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:44.572122 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:44.572566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lazy-loading 'fault' on Instance uuid db0e5602-14b6-4ab8-b7b7-0e383adf09be {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:07:44.613447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:44.620951 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3eef8417-e289-4f49-81c1-722fa5f00f02 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 200 len: 1335 microversion: 2.1 time: 0.095659 Aug 18 11:07:44.621504 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 297/581] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:44 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:45.420685 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0712240d-2822-4adb-8da0-023e6483ef6c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:45.422245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0712240d-2822-4adb-8da0-023e6483ef6c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:45.430472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0712240d-2822-4adb-8da0-023e6483ef6c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:45.431127 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0712240d-2822-4adb-8da0-023e6483ef6c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:45.431712 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0712240d-2822-4adb-8da0-023e6483ef6c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:45.432297 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0712240d-2822-4adb-8da0-023e6483ef6c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:45.432859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0712240d-2822-4adb-8da0-023e6483ef6c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:45.433244 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0712240d-2822-4adb-8da0-023e6483ef6c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:45.521231 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0712240d-2822-4adb-8da0-023e6483ef6c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:45.528674 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0712240d-2822-4adb-8da0-023e6483ef6c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 200 len: 1614 microversion: 2.1 time: 0.112267 Aug 18 11:07:45.529480 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 285/582] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:45 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:45.603630 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-67b7cfcc-c897-40e6-8683-2ab778ca4a0a req-001ae3b7-07a6-442f-9352-b61b416625d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4d3790-5385-4465-bce8-56ca982c4847", "name": "network-vif-deleted", "tag": "c9ccab46-14a6-448e-a1fb-213238710faa"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:45.618429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-67b7cfcc-c897-40e6-8683-2ab778ca4a0a req-001ae3b7-07a6-442f-9352-b61b416625d5 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:45.619988 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-67b7cfcc-c897-40e6-8683-2ab778ca4a0a req-001ae3b7-07a6-442f-9352-b61b416625d5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:45.621080 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-67b7cfcc-c897-40e6-8683-2ab778ca4a0a req-001ae3b7-07a6-442f-9352-b61b416625d5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:45.637893 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-67b7cfcc-c897-40e6-8683-2ab778ca4a0a req-001ae3b7-07a6-442f-9352-b61b416625d5 service nova] Creating event network-vif-deleted:c9ccab46-14a6-448e-a1fb-213238710faa for instance 1f4d3790-5385-4465-bce8-56ca982c4847 on hv-cinder-82660 Aug 18 11:07:45.644080 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:45.644297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-67b7cfcc-c897-40e6-8683-2ab778ca4a0a req-001ae3b7-07a6-442f-9352-b61b416625d5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044130 Aug 18 11:07:45.645096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: db0e5602-14b6-4ab8-b7b7-0e383adf09be] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:45.645355 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 298/583] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:45.654458 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:45.656753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:45.657532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:45.658464 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:45.659128 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:45.659627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:45.674979 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] HTTP exception thrown: Instance db0e5602-14b6-4ab8-b7b7-0e383adf09be could not be found. Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Request method failure captured: Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be HTTP/1.1 Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxam_PDtHLJ-db5zv1qGiOCPbd3HWvSOcxHKrEBJUuzC3C5ATuhSDKsXDjDt3keom5aC4VKFM0yo-U3IE2mEa8cDWLU7B_5Bw9hsBkjmr1uNdMjfzpoIgQRA5wa2VVGVTFWmQFjAgWRd9jH9QKt3AZ88iAfa8bKcQcrFgjEq9EoStU Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: ae09c11177204226a2aa5bb600ee575b Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:07:45.676939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ae09c11177204226a2aa5bb600ee575b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ae09c11177204226a2aa5bb600ee575b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ae09c11177204226a2aa5bb600ee575b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ae09c11177204226a2aa5bb600ee575b"}]}] Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: ae09c11177204226a2aa5bb600ee575b Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-ServerRescueNegativeTestJSON-868309121-project Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 074cfcc7943349a490b29cd4ae3364cb Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-868309121-project Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance db0e5602-14b6-4ab8-b7b7-0e383adf09be could not be found. Aug 18 11:07:45.678541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'db0e5602-14b6-4ab8-b7b7-0e383adf09be'} Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0e5602-14b6-4ab8-b7b7-0e383adf09be could not be found. Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:07:45.679427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0e5602-14b6-4ab8-b7b7-0e383adf09be could not be found. Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0e5602-14b6-4ab8-b7b7-0e383adf09be could not be found. Aug 18 11:07:45.680808 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:45.682994 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Returning 404 to user: Instance db0e5602-14b6-4ab8-b7b7-0e383adf09be could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:07:45.684414 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1099c006-efc5-4560-bc63-d04aa369ad5a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be" status: 404 len: 111 microversion: 2.1 time: 0.045327 Aug 18 11:07:45.685505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 286/584] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:45 2022] GET /compute/v2.1/servers/db0e5602-14b6-4ab8-b7b7-0e383adf09be => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:07:45.695143 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4247c6ef-2fd2-49ce-91ae-f19a3050d3b1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '.version_select at 0x7f7ec8bc8670>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:45.717552 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4247c6ef-2fd2-49ce-91ae-f19a3050d3b1 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237348917" status: 202 len: 0 microversion: 2.1 time: 0.026725 Aug 18 11:07:45.718461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 299/585] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Aug 18 11:07:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237348917 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:07:46.549757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:46.550907 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:46.557220 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:46.557724 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:46.558166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:46.558865 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:46.559318 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:46.559740 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:46.575352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 HTTP/1.1 Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:07:46.576889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:07:46.578780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '1f4d3790-5385-4465-bce8-56ca982c4847'} Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:07:46.579576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:07:46.580947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:46.582641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:07:46.582641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3665df7a-0b67-4665-87a8-bf6928eecc57 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 404 len: 111 microversion: 2.1 time: 0.033070 Aug 18 11:07:46.582641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 287/586] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:46 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:07:46.591588 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-057741bc-31e7-4115-9f53-d0817e3ce346 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '.version_select at 0x7f7ec8ad7310>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:46.617220 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-057741bc-31e7-4115-9f53-d0817e3ce346 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426675827" status: 202 len: 0 microversion: 2.1 time: 0.032959 Aug 18 11:07:46.618575 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 300/587] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Aug 18 11:07:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426675827 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:07:47.302750 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6b020149-54b1-43c2-8041-610651fb8a6b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: .version_select at 0x7f7ec8acbca0>, body: {"keypair": {"name": "tempest-keypair-756475826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgSNAkuCf827hAo+PJxpDyZNmHJxwZu+qwgjq92xQ9PAS2tQKt+YV1b1P9XoHhfkZBchUhyDWKdtbUaB5RSHZUJF+r8DDocBQ9dZa6rzDK3uJq0OoTUcDNVzQpsja+GxQ=="}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:47.318840 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-6b020149-54b1-43c2-8041-610651fb8a6b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for project 397eac573c2d473e881b07c87255700c. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:07:47.322775 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-6b020149-54b1-43c2-8041-610651fb8a6b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for user 57e117589fc14e4d9d8d8494bddf9c12 and project 397eac573c2d473e881b07c87255700c. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:07:47.347003 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6b020149-54b1-43c2-8041-610651fb8a6b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047857 Aug 18 11:07:47.347595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 288/588] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Aug 18 11:07:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:48.632699 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1167145555", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88f1fd75-57ea-4549-97f2-02b6b8fc6e1b"}], "security_groups": [{"name": "tempest-securitygroup--1246781746"}], "key_name": "tempest-keypair-756475826", "user_data": "}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:48.641248 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:48.687769 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2e82c70d-a3f6-45a3-8eba-118a686d308c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:48.688299 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2e82c70d-a3f6-45a3-8eba-118a686d308c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:48.690165 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:48.696197 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2e82c70d-a3f6-45a3-8eba-118a686d308c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:48.696680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2e82c70d-a3f6-45a3-8eba-118a686d308c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:48.697112 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2e82c70d-a3f6-45a3-8eba-118a686d308c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:48.697886 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2e82c70d-a3f6-45a3-8eba-118a686d308c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:48.698334 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2e82c70d-a3f6-45a3-8eba-118a686d308c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:48.698754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2e82c70d-a3f6-45a3-8eba-118a686d308c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:48.724380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2e82c70d-a3f6-45a3-8eba-118a686d308c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:07:48.744979 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.network.neutron [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] validate_networks() for [('88f1fd75-57ea-4549-97f2-02b6b8fc6e1b', None, None, None, None, None)] {{(pid=120800) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:07:48.806938 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2e82c70d-a3f6-45a3-8eba-118a686d308c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 204 len: 0 microversion: 2.1 time: 0.123959 Aug 18 11:07:48.807926 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 289/589] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:07:48 2022] DELETE /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:07:48.817732 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0ec0d17a-1d20-46fe-b4bd-50a15520b80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:48.818346 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0ec0d17a-1d20-46fe-b4bd-50a15520b80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:48.824513 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0ec0d17a-1d20-46fe-b4bd-50a15520b80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:48.824999 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0ec0d17a-1d20-46fe-b4bd-50a15520b80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:48.825436 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0ec0d17a-1d20-46fe-b4bd-50a15520b80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:48.826158 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0ec0d17a-1d20-46fe-b4bd-50a15520b80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:48.826619 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0ec0d17a-1d20-46fe-b4bd-50a15520b80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:48.827075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0ec0d17a-1d20-46fe-b4bd-50a15520b80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:48.976037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0ec0d17a-1d20-46fe-b4bd-50a15520b80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:48.984650 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0ec0d17a-1d20-46fe-b4bd-50a15520b80d tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1508 microversion: 2.1 time: 0.170893 Aug 18 11:07:48.984904 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 290/590] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:48 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:49.137757 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Flavor limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:07:49.138183 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Image limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:07:49.138658 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Flavor pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:07:49.139067 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Image pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:07:49.139506 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:07:49.148801 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:49.149283 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:49.149756 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:49.150483 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:49.150938 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:49.151363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:49.169303 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for project 397eac573c2d473e881b07c87255700c. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:07:49.174214 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Getting quotas for user 57e117589fc14e4d9d8d8494bddf9c12 and project 397eac573c2d473e881b07c87255700c. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:07:49.185353 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Going to run 1 instances... {{(pid=120800) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:07:49.187767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:07:49.238457 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1fb38b0a-eac4-4265-8a99-c76be5b92d1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.610708 Aug 18 11:07:49.239111 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 301/591] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:07:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:07:49.253087 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-092114cb-1176-411f-ab10-ac03abb1d898 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:49.253658 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-092114cb-1176-411f-ab10-ac03abb1d898 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:49.310051 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-092114cb-1176-411f-ab10-ac03abb1d898 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:49.316913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-092114cb-1176-411f-ab10-ac03abb1d898 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1241 microversion: 2.1 time: 0.068083 Aug 18 11:07:49.317263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 291/592] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:49 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:50.006299 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-49876178-ad3d-4365-a86f-26eb0a5b8a71 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:50.006907 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-49876178-ad3d-4365-a86f-26eb0a5b8a71 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:50.013253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-49876178-ad3d-4365-a86f-26eb0a5b8a71 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:50.013786 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-49876178-ad3d-4365-a86f-26eb0a5b8a71 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:50.014244 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-49876178-ad3d-4365-a86f-26eb0a5b8a71 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:50.016187 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-49876178-ad3d-4365-a86f-26eb0a5b8a71 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:50.016653 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-49876178-ad3d-4365-a86f-26eb0a5b8a71 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:50.017085 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-49876178-ad3d-4365-a86f-26eb0a5b8a71 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:50.154895 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-49876178-ad3d-4365-a86f-26eb0a5b8a71 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:50.162719 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-49876178-ad3d-4365-a86f-26eb0a5b8a71 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1508 microversion: 2.1 time: 0.160783 Aug 18 11:07:50.163301 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 302/593] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:50 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:07:50.337935 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b113609d-fafe-425d-ab60-dd368c404d76 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:50.338456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b113609d-fafe-425d-ab60-dd368c404d76 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:50.345063 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b113609d-fafe-425d-ab60-dd368c404d76 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:50.345595 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b113609d-fafe-425d-ab60-dd368c404d76 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:50.346035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b113609d-fafe-425d-ab60-dd368c404d76 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:50.346753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b113609d-fafe-425d-ab60-dd368c404d76 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:50.347210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b113609d-fafe-425d-ab60-dd368c404d76 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:50.347637 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b113609d-fafe-425d-ab60-dd368c404d76 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:50.409711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b113609d-fafe-425d-ab60-dd368c404d76 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:50.417193 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b113609d-fafe-425d-ab60-dd368c404d76 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1245 microversion: 2.1 time: 0.083387 Aug 18 11:07:50.418832 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 292/594] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:50 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:51.240528 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f2586f5b-1c4c-4a3a-8fca-02c4238ae93a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:51.241148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f2586f5b-1c4c-4a3a-8fca-02c4238ae93a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:51.247087 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f2586f5b-1c4c-4a3a-8fca-02c4238ae93a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:51.247562 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f2586f5b-1c4c-4a3a-8fca-02c4238ae93a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:51.247996 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f2586f5b-1c4c-4a3a-8fca-02c4238ae93a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:51.249252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f2586f5b-1c4c-4a3a-8fca-02c4238ae93a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:51.249896 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f2586f5b-1c4c-4a3a-8fca-02c4238ae93a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:51.250323 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f2586f5b-1c4c-4a3a-8fca-02c4238ae93a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:51.382430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f2586f5b-1c4c-4a3a-8fca-02c4238ae93a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:51.390604 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f2586f5b-1c4c-4a3a-8fca-02c4238ae93a tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1508 microversion: 2.1 time: 0.210150 Aug 18 11:07:51.391156 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 303/595] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:51 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:51.439798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-21818623-1651-4b8c-9468-b559f3d90ab5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:51.440373 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-21818623-1651-4b8c-9468-b559f3d90ab5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:51.446828 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21818623-1651-4b8c-9468-b559f3d90ab5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:51.447315 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21818623-1651-4b8c-9468-b559f3d90ab5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:51.447752 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21818623-1651-4b8c-9468-b559f3d90ab5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:51.448511 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21818623-1651-4b8c-9468-b559f3d90ab5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:51.448969 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21818623-1651-4b8c-9468-b559f3d90ab5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:51.449396 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-21818623-1651-4b8c-9468-b559f3d90ab5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:51.455995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:51.548303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-21818623-1651-4b8c-9468-b559f3d90ab5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:51.559066 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-21818623-1651-4b8c-9468-b559f3d90ab5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1293 microversion: 2.1 time: 0.123968 Aug 18 11:07:51.588743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 293/596] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:51 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:52.054107 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-6fdc2e49-8fed-4334-ab50-627eb78dcc2c req-d6bbf6fe-b937-46ff-a8f8-2c31247c5c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84d6955-9f03-4572-8bc7-afe5a9051ca2", "name": "network-vif-deleted", "tag": "b889406a-fd6b-4f05-afb7-b8863a6cfc75"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:52.067115 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6fdc2e49-8fed-4334-ab50-627eb78dcc2c req-d6bbf6fe-b937-46ff-a8f8-2c31247c5c41 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:52.067953 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6fdc2e49-8fed-4334-ab50-627eb78dcc2c req-d6bbf6fe-b937-46ff-a8f8-2c31247c5c41 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:52.068595 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6fdc2e49-8fed-4334-ab50-627eb78dcc2c req-d6bbf6fe-b937-46ff-a8f8-2c31247c5c41 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:52.082929 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-6fdc2e49-8fed-4334-ab50-627eb78dcc2c req-d6bbf6fe-b937-46ff-a8f8-2c31247c5c41 service nova] Creating event network-vif-deleted:b889406a-fd6b-4f05-afb7-b8863a6cfc75 for instance b84d6955-9f03-4572-8bc7-afe5a9051ca2 on hv-cinder-82660 Aug 18 11:07:52.088728 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-6fdc2e49-8fed-4334-ab50-627eb78dcc2c req-d6bbf6fe-b937-46ff-a8f8-2c31247c5c41 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038177 Aug 18 11:07:52.089658 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 304/597] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:52.411543 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:52.412495 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:52.420965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:52.421837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:52.422490 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:52.424033 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:52.424782 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:52.425469 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:52.462525 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:52.463230 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:52.463728 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:52.464297 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lazy-loading 'fault' on Instance uuid b84d6955-9f03-4572-8bc7-afe5a9051ca2 {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:07:52.582537 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8537a3f1-e7db-4c96-91d7-edc2c8aaf85e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:52.583877 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8537a3f1-e7db-4c96-91d7-edc2c8aaf85e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:52.591478 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8537a3f1-e7db-4c96-91d7-edc2c8aaf85e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:52.593715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8537a3f1-e7db-4c96-91d7-edc2c8aaf85e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:52.593715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8537a3f1-e7db-4c96-91d7-edc2c8aaf85e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:52.594949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8537a3f1-e7db-4c96-91d7-edc2c8aaf85e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:52.595830 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8537a3f1-e7db-4c96-91d7-edc2c8aaf85e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:52.596436 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8537a3f1-e7db-4c96-91d7-edc2c8aaf85e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:52.665651 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8537a3f1-e7db-4c96-91d7-edc2c8aaf85e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:52.675014 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8537a3f1-e7db-4c96-91d7-edc2c8aaf85e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1299 microversion: 2.1 time: 0.098282 Aug 18 11:07:52.675597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 305/598] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:52 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:07:52.778643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:52.786046 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-03fc3d44-ef94-4527-a7f3-8544677d8286 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 200 len: 1312 microversion: 2.1 time: 0.378251 Aug 18 11:07:52.786889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 294/599] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:52 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:53.695535 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ad65f7b2-00c9-42c3-98fe-62fd710b04c5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:53.696151 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ad65f7b2-00c9-42c3-98fe-62fd710b04c5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:53.702937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ad65f7b2-00c9-42c3-98fe-62fd710b04c5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:53.703597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ad65f7b2-00c9-42c3-98fe-62fd710b04c5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:53.704350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ad65f7b2-00c9-42c3-98fe-62fd710b04c5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:53.705323 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ad65f7b2-00c9-42c3-98fe-62fd710b04c5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:53.705816 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ad65f7b2-00c9-42c3-98fe-62fd710b04c5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:53.706246 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ad65f7b2-00c9-42c3-98fe-62fd710b04c5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:53.772062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-2b5fc633-9ae7-41d1-ab9d-f2b174602ec7 req-9405052b-126a-4ab0-8087-aac44f9d49ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13", "tag": "6c7b232e-13c7-4bc6-a2a8-aa7ab1248856"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:53.785560 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-2b5fc633-9ae7-41d1-ab9d-f2b174602ec7 req-9405052b-126a-4ab0-8087-aac44f9d49ca service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:53.786752 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-2b5fc633-9ae7-41d1-ab9d-f2b174602ec7 req-9405052b-126a-4ab0-8087-aac44f9d49ca service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:53.787452 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-2b5fc633-9ae7-41d1-ab9d-f2b174602ec7 req-9405052b-126a-4ab0-8087-aac44f9d49ca service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:53.803015 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-2b5fc633-9ae7-41d1-ab9d-f2b174602ec7 req-9405052b-126a-4ab0-8087-aac44f9d49ca service nova] Creating event network-changed:6c7b232e-13c7-4bc6-a2a8-aa7ab1248856 for instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 on hv-cinder-82660 Aug 18 11:07:53.814394 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-2b5fc633-9ae7-41d1-ab9d-f2b174602ec7 req-9405052b-126a-4ab0-8087-aac44f9d49ca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045239 Aug 18 11:07:53.815119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 295/600] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:07:53.820923 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:53.821761 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: b84d6955-9f03-4572-8bc7-afe5a9051ca2] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:53.829206 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:53.829766 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:53.830268 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:53.831218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:53.831740 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:53.832227 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:53.849803 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] HTTP exception thrown: Instance b84d6955-9f03-4572-8bc7-afe5a9051ca2 could not be found. Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Request method failure captured: Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 HTTP/1.1 Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxam_PDtHLJ-db5zv1qGiOCPbd3HWvSOcxHKrEBJUuzC3C5ATuhSDKsXDjDt3keom5aC4VKFM0yo-U3IE2mEa8cDWLU7B_5Bw9hsBkjmr1uNdMjfzpoIgQRA5wa2VVGVTFWmQFjAgWRd9jH9QKt3AZ88iAfa8bKcQcrFgjEq9EoStU Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: ae09c11177204226a2aa5bb600ee575b Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:07:53.851605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ae09c11177204226a2aa5bb600ee575b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ae09c11177204226a2aa5bb600ee575b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ae09c11177204226a2aa5bb600ee575b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ae09c11177204226a2aa5bb600ee575b"}]}] Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: ae09c11177204226a2aa5bb600ee575b Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-ServerRescueNegativeTestJSON-868309121-project Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 074cfcc7943349a490b29cd4ae3364cb Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-868309121-project Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance b84d6955-9f03-4572-8bc7-afe5a9051ca2 could not be found. Aug 18 11:07:53.852868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'b84d6955-9f03-4572-8bc7-afe5a9051ca2'} Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84d6955-9f03-4572-8bc7-afe5a9051ca2 could not be found. Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:07:53.853597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84d6955-9f03-4572-8bc7-afe5a9051ca2 could not be found. Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84d6955-9f03-4572-8bc7-afe5a9051ca2 could not be found. Aug 18 11:07:53.854946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:53.856952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Returning 404 to user: Instance b84d6955-9f03-4572-8bc7-afe5a9051ca2 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:07:53.856952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-15a9d80a-e4c5-467b-ae3f-3ca73cb0fed8 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2" status: 404 len: 111 microversion: 2.1 time: 0.036361 Aug 18 11:07:53.856952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 296/601] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:53 2022] GET /compute/v2.1/servers/b84d6955-9f03-4572-8bc7-afe5a9051ca2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:07:53.865802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f92ccd23-3388-45d9-9255-c108b3fbde7e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:53.866564 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f92ccd23-3388-45d9-9255-c108b3fbde7e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:53.874965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f92ccd23-3388-45d9-9255-c108b3fbde7e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:53.875598 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f92ccd23-3388-45d9-9255-c108b3fbde7e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:53.876124 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f92ccd23-3388-45d9-9255-c108b3fbde7e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:53.876917 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f92ccd23-3388-45d9-9255-c108b3fbde7e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:53.877572 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f92ccd23-3388-45d9-9255-c108b3fbde7e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:53.878228 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f92ccd23-3388-45d9-9255-c108b3fbde7e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:53.896180 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ad65f7b2-00c9-42c3-98fe-62fd710b04c5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:53.905828 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ad65f7b2-00c9-42c3-98fe-62fd710b04c5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1367 microversion: 2.1 time: 0.213239 Aug 18 11:07:53.907253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 306/602] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:53 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:53.912266 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f92ccd23-3388-45d9-9255-c108b3fbde7e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:07:53.992464 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f92ccd23-3388-45d9-9255-c108b3fbde7e tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 204 len: 0 microversion: 2.1 time: 0.131113 Aug 18 11:07:53.993090 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 297/603] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:07:53 2022] DELETE /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:07:54.001341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a0f91de4-5407-4165-b78a-ce5d655f80ff tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:54.001969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a0f91de4-5407-4165-b78a-ce5d655f80ff tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:54.008013 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a0f91de4-5407-4165-b78a-ce5d655f80ff tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:54.008856 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a0f91de4-5407-4165-b78a-ce5d655f80ff tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:54.009302 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a0f91de4-5407-4165-b78a-ce5d655f80ff tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:54.010030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a0f91de4-5407-4165-b78a-ce5d655f80ff tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:54.010477 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a0f91de4-5407-4165-b78a-ce5d655f80ff tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:54.010893 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a0f91de4-5407-4165-b78a-ce5d655f80ff tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:54.139664 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a0f91de4-5407-4165-b78a-ce5d655f80ff tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:54.148253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a0f91de4-5407-4165-b78a-ce5d655f80ff tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.150957 Aug 18 11:07:54.148912 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 307/604] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:53 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:07:54.934879 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1bab7f75-e61b-4e7a-b8e3-800e1e74db8a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:54.935496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1bab7f75-e61b-4e7a-b8e3-800e1e74db8a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:54.943213 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1bab7f75-e61b-4e7a-b8e3-800e1e74db8a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:54.943701 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1bab7f75-e61b-4e7a-b8e3-800e1e74db8a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:54.944141 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1bab7f75-e61b-4e7a-b8e3-800e1e74db8a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:54.944838 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1bab7f75-e61b-4e7a-b8e3-800e1e74db8a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:54.945292 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1bab7f75-e61b-4e7a-b8e3-800e1e74db8a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:54.945746 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1bab7f75-e61b-4e7a-b8e3-800e1e74db8a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:55.082136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1bab7f75-e61b-4e7a-b8e3-800e1e74db8a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:55.089555 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1bab7f75-e61b-4e7a-b8e3-800e1e74db8a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1367 microversion: 2.1 time: 0.158967 Aug 18 11:07:55.090133 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 298/605] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:54 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:55.169799 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-03e003a1-d428-427c-8e9b-8fe45d0931f2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:55.170409 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-03e003a1-d428-427c-8e9b-8fe45d0931f2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:55.177648 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-03e003a1-d428-427c-8e9b-8fe45d0931f2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:55.178137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-03e003a1-d428-427c-8e9b-8fe45d0931f2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:55.178575 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-03e003a1-d428-427c-8e9b-8fe45d0931f2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:55.179266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-03e003a1-d428-427c-8e9b-8fe45d0931f2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:55.179720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-03e003a1-d428-427c-8e9b-8fe45d0931f2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:55.180143 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-03e003a1-d428-427c-8e9b-8fe45d0931f2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:55.315944 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-03e003a1-d428-427c-8e9b-8fe45d0931f2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:55.323319 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-03e003a1-d428-427c-8e9b-8fe45d0931f2 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.157635 Aug 18 11:07:55.323877 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 308/606] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:55 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:56.111737 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d90ae78f-dd80-4d48-91c7-9eb0145f19f8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:56.112463 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d90ae78f-dd80-4d48-91c7-9eb0145f19f8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:56.118861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d90ae78f-dd80-4d48-91c7-9eb0145f19f8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:56.119336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d90ae78f-dd80-4d48-91c7-9eb0145f19f8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:56.119765 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d90ae78f-dd80-4d48-91c7-9eb0145f19f8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:56.120445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d90ae78f-dd80-4d48-91c7-9eb0145f19f8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:56.120887 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d90ae78f-dd80-4d48-91c7-9eb0145f19f8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:56.121306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d90ae78f-dd80-4d48-91c7-9eb0145f19f8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:56.256623 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d90ae78f-dd80-4d48-91c7-9eb0145f19f8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:56.264578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d90ae78f-dd80-4d48-91c7-9eb0145f19f8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1367 microversion: 2.1 time: 0.157022 Aug 18 11:07:56.265023 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 299/607] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:56 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:56.344765 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a090c741-1e0f-4e5e-8453-9aa134070654 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:56.345388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a090c741-1e0f-4e5e-8453-9aa134070654 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:56.351738 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a090c741-1e0f-4e5e-8453-9aa134070654 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:56.352215 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a090c741-1e0f-4e5e-8453-9aa134070654 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:56.352671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a090c741-1e0f-4e5e-8453-9aa134070654 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:56.353453 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a090c741-1e0f-4e5e-8453-9aa134070654 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:56.353924 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a090c741-1e0f-4e5e-8453-9aa134070654 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:56.354340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a090c741-1e0f-4e5e-8453-9aa134070654 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:56.372615 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:56.491686 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a090c741-1e0f-4e5e-8453-9aa134070654 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:56.499160 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a090c741-1e0f-4e5e-8453-9aa134070654 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.158328 Aug 18 11:07:56.499841 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 309/608] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:56 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:57.285324 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f8f8054e-d346-4aff-bfc1-ba498d1d6fd7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:57.285991 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f8f8054e-d346-4aff-bfc1-ba498d1d6fd7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:57.292429 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f8f8054e-d346-4aff-bfc1-ba498d1d6fd7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:57.293157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f8f8054e-d346-4aff-bfc1-ba498d1d6fd7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:57.293637 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f8f8054e-d346-4aff-bfc1-ba498d1d6fd7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:57.294331 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f8f8054e-d346-4aff-bfc1-ba498d1d6fd7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:57.294785 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f8f8054e-d346-4aff-bfc1-ba498d1d6fd7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:57.295213 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f8f8054e-d346-4aff-bfc1-ba498d1d6fd7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:57.474466 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f8f8054e-d346-4aff-bfc1-ba498d1d6fd7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:57.481963 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f8f8054e-d346-4aff-bfc1-ba498d1d6fd7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1367 microversion: 2.1 time: 0.201380 Aug 18 11:07:57.482524 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 300/609] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:57 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:57.520148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8cc06891-1671-4339-9274-09e8e8e2436c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:57.520785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8cc06891-1671-4339-9274-09e8e8e2436c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:57.526878 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8cc06891-1671-4339-9274-09e8e8e2436c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:57.527363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8cc06891-1671-4339-9274-09e8e8e2436c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:57.527800 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8cc06891-1671-4339-9274-09e8e8e2436c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:57.528512 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8cc06891-1671-4339-9274-09e8e8e2436c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:57.528965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8cc06891-1671-4339-9274-09e8e8e2436c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:57.529387 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8cc06891-1671-4339-9274-09e8e8e2436c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:57.664001 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8cc06891-1671-4339-9274-09e8e8e2436c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:57.671868 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8cc06891-1671-4339-9274-09e8e8e2436c tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1523 microversion: 2.1 time: 0.155655 Aug 18 11:07:57.672419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 310/610] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:57 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:58.504303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-210cd754-c11b-47f2-9412-7900ad595e72 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:58.505028 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-210cd754-c11b-47f2-9412-7900ad595e72 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:58.511539 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-210cd754-c11b-47f2-9412-7900ad595e72 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:58.512107 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-210cd754-c11b-47f2-9412-7900ad595e72 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:58.512548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-210cd754-c11b-47f2-9412-7900ad595e72 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:58.513244 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-210cd754-c11b-47f2-9412-7900ad595e72 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:58.513727 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-210cd754-c11b-47f2-9412-7900ad595e72 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:58.514152 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-210cd754-c11b-47f2-9412-7900ad595e72 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:58.692958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-45e95a5b-6ef6-4ae0-89b3-2870199443e3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:58.693797 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-45e95a5b-6ef6-4ae0-89b3-2870199443e3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:58.701054 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45e95a5b-6ef6-4ae0-89b3-2870199443e3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:58.701680 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45e95a5b-6ef6-4ae0-89b3-2870199443e3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:58.702185 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45e95a5b-6ef6-4ae0-89b3-2870199443e3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:58.703011 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45e95a5b-6ef6-4ae0-89b3-2870199443e3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:58.703544 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45e95a5b-6ef6-4ae0-89b3-2870199443e3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:58.704156 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-45e95a5b-6ef6-4ae0-89b3-2870199443e3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:58.781891 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-45e95a5b-6ef6-4ae0-89b3-2870199443e3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074cfcc7943349a490b29cd4ae3364cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae09c11177204226a2aa5bb600ee575b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:58.790804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-45e95a5b-6ef6-4ae0-89b3-2870199443e3 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 200 len: 1481 microversion: 2.1 time: 0.101673 Aug 18 11:07:58.797992 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 311/611] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:58 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 1481 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:07:58.807206 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-210cd754-c11b-47f2-9412-7900ad595e72 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:07:58.817998 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-210cd754-c11b-47f2-9412-7900ad595e72 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1367 microversion: 2.1 time: 0.318119 Aug 18 11:07:58.823375 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-b9d84c8f-ea08-4d00-9ed2-89b160a689e9 req-db474cfd-9f3e-445c-a917-8bb0f8ecc032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf6cfd1-8e48-4e4e-9a3b-05363568e762", "name": "network-vif-deleted", "tag": "c75ad995-e60d-4b15-bf38-31d1772db191"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:07:58.827214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 301/612] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:58 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:07:58.834677 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-b9d84c8f-ea08-4d00-9ed2-89b160a689e9 req-db474cfd-9f3e-445c-a917-8bb0f8ecc032 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:58.835261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-b9d84c8f-ea08-4d00-9ed2-89b160a689e9 req-db474cfd-9f3e-445c-a917-8bb0f8ecc032 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:58.835778 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-b9d84c8f-ea08-4d00-9ed2-89b160a689e9 req-db474cfd-9f3e-445c-a917-8bb0f8ecc032 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:58.850198 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-b9d84c8f-ea08-4d00-9ed2-89b160a689e9 req-db474cfd-9f3e-445c-a917-8bb0f8ecc032 service nova] Creating event network-vif-deleted:c75ad995-e60d-4b15-bf38-31d1772db191 for instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 on hv-cinder-82660 Aug 18 11:07:58.857037 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-b9d84c8f-ea08-4d00-9ed2-89b160a689e9 req-db474cfd-9f3e-445c-a917-8bb0f8ecc032 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038512 Aug 18 11:07:58.857755 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 312/613] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:07:59.813707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:59.814448 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] [instance: 8bf6cfd1-8e48-4e4e-9a3b-05363568e762] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:59.816507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=6 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:59.822402 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:59.822892 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:59.823332 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:59.824038 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:59.824493 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:59.824920 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:59.836839 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:59.837634 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=6 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:07:59.839656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] HTTP exception thrown: Instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 could not be found. Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Request method failure captured: Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 HTTP/1.1 Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxam_PDtHLJ-db5zv1qGiOCPbd3HWvSOcxHKrEBJUuzC3C5ATuhSDKsXDjDt3keom5aC4VKFM0yo-U3IE2mEa8cDWLU7B_5Bw9hsBkjmr1uNdMjfzpoIgQRA5wa2VVGVTFWmQFjAgWRd9jH9QKt3AZ88iAfa8bKcQcrFgjEq9EoStU Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: ae09c11177204226a2aa5bb600ee575b Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:07:59.841459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ae09c11177204226a2aa5bb600ee575b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ae09c11177204226a2aa5bb600ee575b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ae09c11177204226a2aa5bb600ee575b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ae09c11177204226a2aa5bb600ee575b"}]}] Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: ae09c11177204226a2aa5bb600ee575b Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-868309121 Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-ServerRescueNegativeTestJSON-868309121-project Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 074cfcc7943349a490b29cd4ae3364cb Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-868309121-project Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 could not be found. Aug 18 11:07:59.843261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '8bf6cfd1-8e48-4e4e-9a3b-05363568e762'} Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 could not be found. Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:07:59.844759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 could not be found. Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 could not be found. Aug 18 11:07:59.846320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:07:59.847578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] Returning 404 to user: Instance 8bf6cfd1-8e48-4e4e-9a3b-05363568e762 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:07:59.847660 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-da1f0e45-8f90-4b9b-952c-fde18ead773b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:07:59.847747 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0fb8033e-89c2-49d1-a1e3-888383aa51a7 tempest-ServerRescueNegativeTestJSON-868309121 tempest-ServerRescueNegativeTestJSON-868309121-project] 10.222.0.15 "GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762" status: 404 len: 111 microversion: 2.1 time: 0.034922 Aug 18 11:07:59.847839 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-da1f0e45-8f90-4b9b-952c-fde18ead773b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:07:59.847921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 302/614] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:59 2022] GET /compute/v2.1/servers/8bf6cfd1-8e48-4e4e-9a3b-05363568e762 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:07:59.851612 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da1f0e45-8f90-4b9b-952c-fde18ead773b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:59.852103 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da1f0e45-8f90-4b9b-952c-fde18ead773b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:59.852544 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da1f0e45-8f90-4b9b-952c-fde18ead773b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:59.853246 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da1f0e45-8f90-4b9b-952c-fde18ead773b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:07:59.853734 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da1f0e45-8f90-4b9b-952c-fde18ead773b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:07:59.854168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da1f0e45-8f90-4b9b-952c-fde18ead773b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:07:59.993789 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-da1f0e45-8f90-4b9b-952c-fde18ead773b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:00.003893 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-da1f0e45-8f90-4b9b-952c-fde18ead773b tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1367 microversion: 2.1 time: 0.167896 Aug 18 11:08:00.005105 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 313/615] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:07:59 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:00.705345 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-4728e49c-03f7-448f-89e3-bfd50473d759 req-511ace6c-9be5-41b2-b241-beed4814c825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13", "name": "network-vif-plugged", "status": "completed", "tag": "6c7b232e-13c7-4bc6-a2a8-aa7ab1248856"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:00.715864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4728e49c-03f7-448f-89e3-bfd50473d759 req-511ace6c-9be5-41b2-b241-beed4814c825 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:00.716629 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4728e49c-03f7-448f-89e3-bfd50473d759 req-511ace6c-9be5-41b2-b241-beed4814c825 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:00.717087 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-4728e49c-03f7-448f-89e3-bfd50473d759 req-511ace6c-9be5-41b2-b241-beed4814c825 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:00.729951 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-4728e49c-03f7-448f-89e3-bfd50473d759 req-511ace6c-9be5-41b2-b241-beed4814c825 service nova] Creating event network-vif-plugged:6c7b232e-13c7-4bc6-a2a8-aa7ab1248856 for instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 on hv-cinder-82660 Aug 18 11:08:00.735750 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-4728e49c-03f7-448f-89e3-bfd50473d759 req-511ace6c-9be5-41b2-b241-beed4814c825 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034777 Aug 18 11:08:00.736348 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 303/616] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:01.026490 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7a3e5bca-3772-44ba-8aa1-d6ed33b74fad tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:01.028675 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7a3e5bca-3772-44ba-8aa1-d6ed33b74fad tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:01.036969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a3e5bca-3772-44ba-8aa1-d6ed33b74fad tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:01.037743 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a3e5bca-3772-44ba-8aa1-d6ed33b74fad tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:01.038418 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a3e5bca-3772-44ba-8aa1-d6ed33b74fad tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:01.039223 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a3e5bca-3772-44ba-8aa1-d6ed33b74fad tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:01.039777 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a3e5bca-3772-44ba-8aa1-d6ed33b74fad tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:01.040347 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7a3e5bca-3772-44ba-8aa1-d6ed33b74fad tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:01.181869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7a3e5bca-3772-44ba-8aa1-d6ed33b74fad tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:01.189549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7a3e5bca-3772-44ba-8aa1-d6ed33b74fad tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1367 microversion: 2.1 time: 0.166872 Aug 18 11:08:01.190122 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 314/617] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:01 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:02.211992 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-edb2cb6c-fa33-42bb-8a96-83cf44e9a2d7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:02.212709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-edb2cb6c-fa33-42bb-8a96-83cf44e9a2d7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:02.220030 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edb2cb6c-fa33-42bb-8a96-83cf44e9a2d7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:02.220522 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edb2cb6c-fa33-42bb-8a96-83cf44e9a2d7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:02.220963 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edb2cb6c-fa33-42bb-8a96-83cf44e9a2d7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:02.221697 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edb2cb6c-fa33-42bb-8a96-83cf44e9a2d7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:02.222154 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edb2cb6c-fa33-42bb-8a96-83cf44e9a2d7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:02.222582 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edb2cb6c-fa33-42bb-8a96-83cf44e9a2d7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:02.505681 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-edb2cb6c-fa33-42bb-8a96-83cf44e9a2d7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:02.514311 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-edb2cb6c-fa33-42bb-8a96-83cf44e9a2d7 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1367 microversion: 2.1 time: 0.307029 Aug 18 11:08:02.515309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 304/618] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:02 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:03.535983 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4857a019-718f-4f06-9f92-c8f0f6051747 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:03.536608 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4857a019-718f-4f06-9f92-c8f0f6051747 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:03.543893 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4857a019-718f-4f06-9f92-c8f0f6051747 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:03.544389 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4857a019-718f-4f06-9f92-c8f0f6051747 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:03.544829 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4857a019-718f-4f06-9f92-c8f0f6051747 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:03.545564 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4857a019-718f-4f06-9f92-c8f0f6051747 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:03.546028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4857a019-718f-4f06-9f92-c8f0f6051747 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:03.547316 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4857a019-718f-4f06-9f92-c8f0f6051747 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:03.722247 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4857a019-718f-4f06-9f92-c8f0f6051747 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:03.730022 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4857a019-718f-4f06-9f92-c8f0f6051747 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1556 microversion: 2.1 time: 0.198790 Aug 18 11:08:03.730692 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 315/619] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:03 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1556 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:03.751535 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a5f8d511-40be-4b4b-b196-deab7cc446d8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:03.752051 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a5f8d511-40be-4b4b-b196-deab7cc446d8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:03.758512 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5f8d511-40be-4b4b-b196-deab7cc446d8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:03.759000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5f8d511-40be-4b4b-b196-deab7cc446d8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:03.759521 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5f8d511-40be-4b4b-b196-deab7cc446d8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:03.760137 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5f8d511-40be-4b4b-b196-deab7cc446d8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:03.760588 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5f8d511-40be-4b4b-b196-deab7cc446d8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:03.761013 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5f8d511-40be-4b4b-b196-deab7cc446d8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:03.846949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a5f8d511-40be-4b4b-b196-deab7cc446d8 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100012 Aug 18 11:08:03.847606 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 305/620] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Aug 18 11:08:03 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:03.857070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-025ae6e8-ee91-4494-a998-53ab87222205 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:03.858375 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-025ae6e8-ee91-4494-a998-53ab87222205 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:03.866025 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-025ae6e8-ee91-4494-a998-53ab87222205 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:03.866581 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-025ae6e8-ee91-4494-a998-53ab87222205 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:03.867055 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-025ae6e8-ee91-4494-a998-53ab87222205 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:03.867847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-025ae6e8-ee91-4494-a998-53ab87222205 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:03.868348 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-025ae6e8-ee91-4494-a998-53ab87222205 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:03.868773 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-025ae6e8-ee91-4494-a998-53ab87222205 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:03.894546 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-025ae6e8-ee91-4494-a998-53ab87222205 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lazy-loading 'flavor' on Instance uuid 192f88e2-9697-4492-ac5f-83e871070136 {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:08:03.977789 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-025ae6e8-ee91-4494-a998-53ab87222205 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "POST /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136/action" status: 202 len: 0 microversion: 2.1 time: 0.124991 Aug 18 11:08:03.978409 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 316/621] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:08:03 2022] POST /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:08:03.987656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-dc031927-67ab-4667-9010-4aa2bb616e31 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:03.988278 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-dc031927-67ab-4667-9010-4aa2bb616e31 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:03.996020 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc031927-67ab-4667-9010-4aa2bb616e31 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:03.996846 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc031927-67ab-4667-9010-4aa2bb616e31 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:03.997399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc031927-67ab-4667-9010-4aa2bb616e31 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:03.998302 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc031927-67ab-4667-9010-4aa2bb616e31 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:03.998737 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc031927-67ab-4667-9010-4aa2bb616e31 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:03.999222 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc031927-67ab-4667-9010-4aa2bb616e31 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:04.134787 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-dc031927-67ab-4667-9010-4aa2bb616e31 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:04.142557 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-dc031927-67ab-4667-9010-4aa2bb616e31 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.159627 Aug 18 11:08:04.143149 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 306/622] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:03 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:04.929096 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-3eba39e1-992e-4d5f-a320-89db6767a92e req-e3ab9f45-ccdf-4be8-8114-dc703f41233e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13", "tag": "6c7b232e-13c7-4bc6-a2a8-aa7ab1248856"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:04.939806 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-3eba39e1-992e-4d5f-a320-89db6767a92e req-e3ab9f45-ccdf-4be8-8114-dc703f41233e service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:04.940199 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-3eba39e1-992e-4d5f-a320-89db6767a92e req-e3ab9f45-ccdf-4be8-8114-dc703f41233e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:04.940636 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-3eba39e1-992e-4d5f-a320-89db6767a92e req-e3ab9f45-ccdf-4be8-8114-dc703f41233e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:04.952607 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-3eba39e1-992e-4d5f-a320-89db6767a92e req-e3ab9f45-ccdf-4be8-8114-dc703f41233e service nova] Creating event network-changed:6c7b232e-13c7-4bc6-a2a8-aa7ab1248856 for instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 on hv-cinder-82660 Aug 18 11:08:04.958703 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-3eba39e1-992e-4d5f-a320-89db6767a92e req-e3ab9f45-ccdf-4be8-8114-dc703f41233e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035065 Aug 18 11:08:04.959558 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 317/623] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:08:05.164627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1d2ef2c7-c1c4-4806-8562-6ace054b5ec1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:05.165261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1d2ef2c7-c1c4-4806-8562-6ace054b5ec1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:05.174231 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d2ef2c7-c1c4-4806-8562-6ace054b5ec1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:05.175445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d2ef2c7-c1c4-4806-8562-6ace054b5ec1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:05.176330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d2ef2c7-c1c4-4806-8562-6ace054b5ec1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:05.177345 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d2ef2c7-c1c4-4806-8562-6ace054b5ec1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:05.178052 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d2ef2c7-c1c4-4806-8562-6ace054b5ec1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:05.178756 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1d2ef2c7-c1c4-4806-8562-6ace054b5ec1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:05.483753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1d2ef2c7-c1c4-4806-8562-6ace054b5ec1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:05.504132 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1d2ef2c7-c1c4-4806-8562-6ace054b5ec1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.332631 Aug 18 11:08:05.504132 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 307/624] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:05 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:06.527091 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fb6dc3c6-2533-4a11-a2c1-ec50aad4fb1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:06.527801 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fb6dc3c6-2533-4a11-a2c1-ec50aad4fb1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:06.535091 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb6dc3c6-2533-4a11-a2c1-ec50aad4fb1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:06.535641 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb6dc3c6-2533-4a11-a2c1-ec50aad4fb1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:06.536024 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb6dc3c6-2533-4a11-a2c1-ec50aad4fb1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:06.536927 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb6dc3c6-2533-4a11-a2c1-ec50aad4fb1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:06.537394 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb6dc3c6-2533-4a11-a2c1-ec50aad4fb1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:06.537850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fb6dc3c6-2533-4a11-a2c1-ec50aad4fb1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:06.776359 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-fb6dc3c6-2533-4a11-a2c1-ec50aad4fb1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:06.785091 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fb6dc3c6-2533-4a11-a2c1-ec50aad4fb1c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.262645 Aug 18 11:08:06.785817 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 318/625] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:06 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:07.816305 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b687ff40-974e-4d0f-9116-237572dc7571 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:07.816305 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b687ff40-974e-4d0f-9116-237572dc7571 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:07.822974 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b687ff40-974e-4d0f-9116-237572dc7571 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:07.823722 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b687ff40-974e-4d0f-9116-237572dc7571 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:07.823913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b687ff40-974e-4d0f-9116-237572dc7571 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:07.824643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b687ff40-974e-4d0f-9116-237572dc7571 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:07.825056 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b687ff40-974e-4d0f-9116-237572dc7571 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:07.825464 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b687ff40-974e-4d0f-9116-237572dc7571 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:07.978880 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b687ff40-974e-4d0f-9116-237572dc7571 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:07.991272 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b687ff40-974e-4d0f-9116-237572dc7571 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.185175 Aug 18 11:08:07.992426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 308/626] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:07 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:09.012783 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6e2a8f79-e39a-4f40-97aa-f160170fdd6f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:09.013377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6e2a8f79-e39a-4f40-97aa-f160170fdd6f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:09.023101 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e2a8f79-e39a-4f40-97aa-f160170fdd6f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:09.023958 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e2a8f79-e39a-4f40-97aa-f160170fdd6f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:09.024976 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e2a8f79-e39a-4f40-97aa-f160170fdd6f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:09.026428 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e2a8f79-e39a-4f40-97aa-f160170fdd6f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:09.027680 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e2a8f79-e39a-4f40-97aa-f160170fdd6f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:09.028352 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6e2a8f79-e39a-4f40-97aa-f160170fdd6f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:09.258162 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6e2a8f79-e39a-4f40-97aa-f160170fdd6f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:09.275536 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6e2a8f79-e39a-4f40-97aa-f160170fdd6f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.265371 Aug 18 11:08:09.285447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 319/627] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:09 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:09.990277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d51fc275-9d52-40a3-8535-2ff163f322c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'create', calling method: .version_select at 0x7f7ec8c02f70>, body: {"keypair": {"name": "tempest-keypair-1401218901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc2699UwczTP4cGm3oyBMA2Wxnot3s8E8bcrJBrhJMS5d3pMZeiE0CJelmOLK7IXvuiWB/vSP2dm9JVirjuHh98ACLx5v4obaoeu+incXH2zSq0HyU2ByLxRZcH81N7Xg=="}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:10.007081 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-d51fc275-9d52-40a3-8535-2ff163f322c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Getting quotas for project c2dd094c20324a7e8bfe6f3ea11dce38. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:08:10.011264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-d51fc275-9d52-40a3-8535-2ff163f322c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Getting quotas for user 932e75ccffec4118b9de434cc59564f7 and project c2dd094c20324a7e8bfe6f3ea11dce38. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:08:10.036184 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d51fc275-9d52-40a3-8535-2ff163f322c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169945 Aug 18 11:08:10.036783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 309/628] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Aug 18 11:08:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:10.305583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1de8e0d1-ebbc-4ffd-9dd3-45057f87aad2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:10.306283 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1de8e0d1-ebbc-4ffd-9dd3-45057f87aad2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:10.327797 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1de8e0d1-ebbc-4ffd-9dd3-45057f87aad2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:10.328435 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1de8e0d1-ebbc-4ffd-9dd3-45057f87aad2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:10.328951 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1de8e0d1-ebbc-4ffd-9dd3-45057f87aad2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:10.329799 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1de8e0d1-ebbc-4ffd-9dd3-45057f87aad2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:10.330576 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1de8e0d1-ebbc-4ffd-9dd3-45057f87aad2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:10.331064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1de8e0d1-ebbc-4ffd-9dd3-45057f87aad2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:10.549368 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1de8e0d1-ebbc-4ffd-9dd3-45057f87aad2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:10.557250 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1de8e0d1-ebbc-4ffd-9dd3-45057f87aad2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.264251 Aug 18 11:08:10.570811 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 320/629] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:10 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:11.492667 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1247379419", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "551dffce-6b62-4983-a0bb-9eee38dc5368"}], "security_groups": [{"name": "tempest-securitygroup--1381445970"}], "key_name": "tempest-keypair-1401218901", "user_data": "}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:11.579039 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f9085e5b-3111-47e3-b5a4-3ea9ba2f04b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:11.579744 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f9085e5b-3111-47e3-b5a4-3ea9ba2f04b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:11.586159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f9085e5b-3111-47e3-b5a4-3ea9ba2f04b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:11.591676 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f9085e5b-3111-47e3-b5a4-3ea9ba2f04b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:11.592150 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f9085e5b-3111-47e3-b5a4-3ea9ba2f04b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:11.593685 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f9085e5b-3111-47e3-b5a4-3ea9ba2f04b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:11.594795 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f9085e5b-3111-47e3-b5a4-3ea9ba2f04b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:11.595235 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f9085e5b-3111-47e3-b5a4-3ea9ba2f04b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:11.626125 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] validate_networks() for [('551dffce-6b62-4983-a0bb-9eee38dc5368', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:08:11.743357 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f9085e5b-3111-47e3-b5a4-3ea9ba2f04b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:11.756291 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f9085e5b-3111-47e3-b5a4-3ea9ba2f04b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.181904 Aug 18 11:08:11.756969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 321/630] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:11 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:12.076048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:08:12.076553 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:08:12.076927 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:08:12.077904 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:08:12.078384 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:08:12.087755 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:12.088238 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:12.088674 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:12.089489 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:12.089885 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:12.090309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:12.109298 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Getting quotas for project c2dd094c20324a7e8bfe6f3ea11dce38. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:08:12.113411 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Getting quotas for user 932e75ccffec4118b9de434cc59564f7 and project c2dd094c20324a7e8bfe6f3ea11dce38. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:08:12.124709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:08:12.127161 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:08:12.173612 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d796b898-188c-4689-a941-c3f40ba331a6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.686180 Aug 18 11:08:12.180330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 310/631] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:08:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:08:12.185439 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-18f8e165-c8d6-4fcc-abb7-8c3c010073fc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:12.186134 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-18f8e165-c8d6-4fcc-abb7-8c3c010073fc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:12.256374 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-18f8e165-c8d6-4fcc-abb7-8c3c010073fc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:12.263638 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-18f8e165-c8d6-4fcc-abb7-8c3c010073fc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1238 microversion: 2.1 time: 0.081962 Aug 18 11:08:12.264205 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 322/632] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:12 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:12.778236 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5b26808e-33ce-4840-a964-9131c52eeae9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:12.778856 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5b26808e-33ce-4840-a964-9131c52eeae9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:12.786135 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b26808e-33ce-4840-a964-9131c52eeae9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:12.786559 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b26808e-33ce-4840-a964-9131c52eeae9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:12.787266 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b26808e-33ce-4840-a964-9131c52eeae9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:12.788083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b26808e-33ce-4840-a964-9131c52eeae9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:12.788548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b26808e-33ce-4840-a964-9131c52eeae9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:12.788981 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b26808e-33ce-4840-a964-9131c52eeae9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:12.973424 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5b26808e-33ce-4840-a964-9131c52eeae9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:12.982241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5b26808e-33ce-4840-a964-9131c52eeae9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.208404 Aug 18 11:08:12.982819 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 311/633] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:12 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:13.027396 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7d47e722-4929-4b14-ba12-2c2018636e84 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:13.027935 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7d47e722-4929-4b14-ba12-2c2018636e84 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:13.047266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7d47e722-4929-4b14-ba12-2c2018636e84 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:13.047772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7d47e722-4929-4b14-ba12-2c2018636e84 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:13.048213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7d47e722-4929-4b14-ba12-2c2018636e84 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:13.048925 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7d47e722-4929-4b14-ba12-2c2018636e84 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:13.049639 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7d47e722-4929-4b14-ba12-2c2018636e84 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:13.050226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7d47e722-4929-4b14-ba12-2c2018636e84 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:13.081989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7d47e722-4929-4b14-ba12-2c2018636e84 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/ips" status: 200 len: 152 microversion: 2.20 time: 0.219198 Aug 18 11:08:13.082562 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 323/634] 10.222.0.15 () {60 vars in 1289 bytes} [Thu Aug 18 11:08:12 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/ips => generated 152 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:08:13.286219 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c9e5df8b-1bce-41ba-94d6-80d7e592c064 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:13.287133 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c9e5df8b-1bce-41ba-94d6-80d7e592c064 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:13.297544 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9e5df8b-1bce-41ba-94d6-80d7e592c064 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:13.298417 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9e5df8b-1bce-41ba-94d6-80d7e592c064 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:13.298903 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9e5df8b-1bce-41ba-94d6-80d7e592c064 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:13.300136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9e5df8b-1bce-41ba-94d6-80d7e592c064 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:13.300958 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9e5df8b-1bce-41ba-94d6-80d7e592c064 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:13.301385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9e5df8b-1bce-41ba-94d6-80d7e592c064 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:13.329188 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:13.388017 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c9e5df8b-1bce-41ba-94d6-80d7e592c064 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:13.398627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c9e5df8b-1bce-41ba-94d6-80d7e592c064 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1290 microversion: 2.1 time: 0.117075 Aug 18 11:08:13.414510 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 312/635] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:13 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1290 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:14.006767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3d190139-bacb-4eb7-971f-f38a604f2858 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:14.007412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3d190139-bacb-4eb7-971f-f38a604f2858 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:14.013976 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3d190139-bacb-4eb7-971f-f38a604f2858 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:14.014457 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3d190139-bacb-4eb7-971f-f38a604f2858 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:14.015747 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3d190139-bacb-4eb7-971f-f38a604f2858 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:14.016865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3d190139-bacb-4eb7-971f-f38a604f2858 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:14.017325 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3d190139-bacb-4eb7-971f-f38a604f2858 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:14.017856 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3d190139-bacb-4eb7-971f-f38a604f2858 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:14.154723 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3d190139-bacb-4eb7-971f-f38a604f2858 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:14.162597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3d190139-bacb-4eb7-971f-f38a604f2858 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.159715 Aug 18 11:08:14.163175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 324/636] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:14 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:14.423060 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fbacef30-0432-4021-87ac-539bb61beb99 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:14.423749 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fbacef30-0432-4021-87ac-539bb61beb99 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:14.430992 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbacef30-0432-4021-87ac-539bb61beb99 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:14.431323 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbacef30-0432-4021-87ac-539bb61beb99 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:14.431783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbacef30-0432-4021-87ac-539bb61beb99 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:14.432522 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbacef30-0432-4021-87ac-539bb61beb99 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:14.432980 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbacef30-0432-4021-87ac-539bb61beb99 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:14.433704 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbacef30-0432-4021-87ac-539bb61beb99 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:14.957727 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fbacef30-0432-4021-87ac-539bb61beb99 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:14.965163 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fbacef30-0432-4021-87ac-539bb61beb99 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1364 microversion: 2.1 time: 0.547652 Aug 18 11:08:14.965796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 313/637] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:14 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1364 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:15.184373 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-21286c4d-2769-4144-b08a-3c2272d6bb86 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:15.185026 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-21286c4d-2769-4144-b08a-3c2272d6bb86 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:15.192979 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21286c4d-2769-4144-b08a-3c2272d6bb86 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:15.193475 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21286c4d-2769-4144-b08a-3c2272d6bb86 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:15.193947 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21286c4d-2769-4144-b08a-3c2272d6bb86 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:15.194653 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21286c4d-2769-4144-b08a-3c2272d6bb86 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:15.195277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21286c4d-2769-4144-b08a-3c2272d6bb86 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:15.195875 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21286c4d-2769-4144-b08a-3c2272d6bb86 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:15.351078 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-21286c4d-2769-4144-b08a-3c2272d6bb86 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:15.359717 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-21286c4d-2769-4144-b08a-3c2272d6bb86 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.178392 Aug 18 11:08:15.360484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 325/638] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:15 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:15.733242 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e00c84c5-2086-44ae-99e2-494e16ea01d3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:15.734533 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e00c84c5-2086-44ae-99e2-494e16ea01d3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:15.740913 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e00c84c5-2086-44ae-99e2-494e16ea01d3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:15.741415 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e00c84c5-2086-44ae-99e2-494e16ea01d3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:15.741899 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e00c84c5-2086-44ae-99e2-494e16ea01d3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:15.742606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e00c84c5-2086-44ae-99e2-494e16ea01d3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:15.743070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e00c84c5-2086-44ae-99e2-494e16ea01d3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:15.743499 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e00c84c5-2086-44ae-99e2-494e16ea01d3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:15.768442 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-e00c84c5-2086-44ae-99e2-494e16ea01d3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lazy-loading 'flavor' on Instance uuid a5aa4f6f-cb29-46ab-b558-e91195e757fc {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:08:15.773628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:15.785300 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-e9c2d40c-4d03-45da-aee4-257f3afd2b9c req-199129fe-d1b5-4e31-b1c9-3fd8695cde2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4584500a-8d03-4227-ac47-c7ea8b80d2ce", "tag": "b0d5a80e-61c6-406b-b831-5f20d3e9500b"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:15.796621 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e9c2d40c-4d03-45da-aee4-257f3afd2b9c req-199129fe-d1b5-4e31-b1c9-3fd8695cde2b service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:15.797103 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e9c2d40c-4d03-45da-aee4-257f3afd2b9c req-199129fe-d1b5-4e31-b1c9-3fd8695cde2b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:15.797554 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e9c2d40c-4d03-45da-aee4-257f3afd2b9c req-199129fe-d1b5-4e31-b1c9-3fd8695cde2b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:15.808682 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-e9c2d40c-4d03-45da-aee4-257f3afd2b9c req-199129fe-d1b5-4e31-b1c9-3fd8695cde2b service nova] Creating event network-changed:b0d5a80e-61c6-406b-b831-5f20d3e9500b for instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce on hv-cinder-82660 Aug 18 11:08:15.815781 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-e9c2d40c-4d03-45da-aee4-257f3afd2b9c req-199129fe-d1b5-4e31-b1c9-3fd8695cde2b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100095 Aug 18 11:08:15.816399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 314/639] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:15.954886 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e00c84c5-2086-44ae-99e2-494e16ea01d3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "POST /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/action" status: 202 len: 0 microversion: 2.20 time: 0.225606 Aug 18 11:08:15.955480 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 326/640] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Aug 18 11:08:15 2022] POST /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:08:15.964059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:15.964755 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:15.971458 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:15.971943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:15.972383 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:15.973076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:15.973558 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:15.973988 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:15.987227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a3f9459d-0378-4651-93ed-9937b8de6c7c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:15.988239 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a3f9459d-0378-4651-93ed-9937b8de6c7c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:15.994529 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3f9459d-0378-4651-93ed-9937b8de6c7c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:15.995018 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3f9459d-0378-4651-93ed-9937b8de6c7c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:15.995453 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3f9459d-0378-4651-93ed-9937b8de6c7c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:15.996151 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3f9459d-0378-4651-93ed-9937b8de6c7c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:15.996604 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3f9459d-0378-4651-93ed-9937b8de6c7c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:15.997022 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3f9459d-0378-4651-93ed-9937b8de6c7c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:16.114041 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:16.122079 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:16.123591 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:16.125614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2c0fbd32-82b6-46ea-85de-1c8e7fba302a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.165600 Aug 18 11:08:16.126136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 315/641] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:15 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:16.144840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a3f9459d-0378-4651-93ed-9937b8de6c7c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:16.152429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a3f9459d-0378-4651-93ed-9937b8de6c7c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1364 microversion: 2.1 time: 0.169910 Aug 18 11:08:16.152988 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 327/642] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:15 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:16.381807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ada24bab-bb6c-44f9-a711-d41e20efec93 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:16.382308 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ada24bab-bb6c-44f9-a711-d41e20efec93 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:16.388315 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ada24bab-bb6c-44f9-a711-d41e20efec93 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:16.388800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ada24bab-bb6c-44f9-a711-d41e20efec93 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:16.389239 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ada24bab-bb6c-44f9-a711-d41e20efec93 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:16.390592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ada24bab-bb6c-44f9-a711-d41e20efec93 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:16.391085 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ada24bab-bb6c-44f9-a711-d41e20efec93 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:16.391514 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ada24bab-bb6c-44f9-a711-d41e20efec93 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:16.527550 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ada24bab-bb6c-44f9-a711-d41e20efec93 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:16.535264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ada24bab-bb6c-44f9-a711-d41e20efec93 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.157461 Aug 18 11:08:16.535818 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 316/643] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:16 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:17.148341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:17.149117 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:17.156268 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:17.156756 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:17.157188 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:17.157900 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:17.158351 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:17.158825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:17.172949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1da3bc6b-b377-42ca-a925-42101438b7a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:17.173748 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1da3bc6b-b377-42ca-a925-42101438b7a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:17.180315 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da3bc6b-b377-42ca-a925-42101438b7a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:17.180972 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da3bc6b-b377-42ca-a925-42101438b7a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:17.181628 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da3bc6b-b377-42ca-a925-42101438b7a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:17.182476 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da3bc6b-b377-42ca-a925-42101438b7a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:17.183104 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da3bc6b-b377-42ca-a925-42101438b7a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:17.183758 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da3bc6b-b377-42ca-a925-42101438b7a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:17.329637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:17.338395 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:17.340038 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:17.341210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-da16588c-9533-428a-8b76-16275127e667 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.196839 Aug 18 11:08:17.341802 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 328/644] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:17 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:17.504209 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1da3bc6b-b377-42ca-a925-42101438b7a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:17.512397 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1da3bc6b-b377-42ca-a925-42101438b7a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1364 microversion: 2.1 time: 0.343982 Aug 18 11:08:17.512968 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 317/645] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:17 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:17.558307 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-26d15e35-44e1-4921-88a0-249cf5d732b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:17.559203 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-26d15e35-44e1-4921-88a0-249cf5d732b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:17.568201 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26d15e35-44e1-4921-88a0-249cf5d732b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:17.569031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26d15e35-44e1-4921-88a0-249cf5d732b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:17.569547 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26d15e35-44e1-4921-88a0-249cf5d732b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:17.570335 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26d15e35-44e1-4921-88a0-249cf5d732b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:17.571022 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26d15e35-44e1-4921-88a0-249cf5d732b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:17.571825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-26d15e35-44e1-4921-88a0-249cf5d732b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:17.720513 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-26d15e35-44e1-4921-88a0-249cf5d732b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:17.728031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-26d15e35-44e1-4921-88a0-249cf5d732b2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.174492 Aug 18 11:08:17.728585 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 329/646] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:17 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:18.366064 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:18.366680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:18.369089 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:18.376281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:18.376774 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:18.377207 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:18.377941 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:18.378393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:18.379010 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:18.522075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:18.531607 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:18.533151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:18.534329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2be92879-8c94-4c64-8727-01955b52e862 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.173298 Aug 18 11:08:18.534883 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 318/647] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:18 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:18.536590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-30251dc2-9316-4596-949e-faefe4f56afd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:18.537771 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-30251dc2-9316-4596-949e-faefe4f56afd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:18.549271 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-30251dc2-9316-4596-949e-faefe4f56afd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:18.549845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-30251dc2-9316-4596-949e-faefe4f56afd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:18.550292 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-30251dc2-9316-4596-949e-faefe4f56afd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:18.551004 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-30251dc2-9316-4596-949e-faefe4f56afd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:18.551470 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-30251dc2-9316-4596-949e-faefe4f56afd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:18.552066 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-30251dc2-9316-4596-949e-faefe4f56afd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:18.681336 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-30251dc2-9316-4596-949e-faefe4f56afd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:18.689784 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-30251dc2-9316-4596-949e-faefe4f56afd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1364 microversion: 2.1 time: 0.158716 Aug 18 11:08:18.690353 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 330/648] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:18 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:18.751393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c11a4f89-d6be-4208-992f-4e9186ba90df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:18.752012 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c11a4f89-d6be-4208-992f-4e9186ba90df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:18.758078 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c11a4f89-d6be-4208-992f-4e9186ba90df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:18.758564 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c11a4f89-d6be-4208-992f-4e9186ba90df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:18.759002 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c11a4f89-d6be-4208-992f-4e9186ba90df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:18.759707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c11a4f89-d6be-4208-992f-4e9186ba90df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:18.760264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c11a4f89-d6be-4208-992f-4e9186ba90df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:18.760702 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c11a4f89-d6be-4208-992f-4e9186ba90df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:18.889868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c11a4f89-d6be-4208-992f-4e9186ba90df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:18.897450 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c11a4f89-d6be-4208-992f-4e9186ba90df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1510 microversion: 2.1 time: 0.152589 Aug 18 11:08:18.898050 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 319/649] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:18 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:18.919190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d62cc139-f7cc-4a5b-b3e4-7f08d20fe5e2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:18.919784 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d62cc139-f7cc-4a5b-b3e4-7f08d20fe5e2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:18.922847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:18.928189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d62cc139-f7cc-4a5b-b3e4-7f08d20fe5e2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:18.928678 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d62cc139-f7cc-4a5b-b3e4-7f08d20fe5e2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:18.929115 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d62cc139-f7cc-4a5b-b3e4-7f08d20fe5e2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:18.929841 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d62cc139-f7cc-4a5b-b3e4-7f08d20fe5e2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:18.930306 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d62cc139-f7cc-4a5b-b3e4-7f08d20fe5e2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:18.930732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d62cc139-f7cc-4a5b-b3e4-7f08d20fe5e2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:18.963638 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d62cc139-f7cc-4a5b-b3e4-7f08d20fe5e2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120800) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 11:08:19.034377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-d62cc139-f7cc-4a5b-b3e4-7f08d20fe5e2 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "POST /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136/action" status: 202 len: 0 microversion: 2.1 time: 0.119058 Aug 18 11:08:19.035006 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 331/650] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:08:18 2022] POST /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:08:19.043558 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6d60713f-abc8-4923-b4a1-3abf8d2048b1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:19.044184 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6d60713f-abc8-4923-b4a1-3abf8d2048b1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:19.051659 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d60713f-abc8-4923-b4a1-3abf8d2048b1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:19.052152 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d60713f-abc8-4923-b4a1-3abf8d2048b1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:19.052597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d60713f-abc8-4923-b4a1-3abf8d2048b1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:19.053296 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d60713f-abc8-4923-b4a1-3abf8d2048b1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:19.053796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d60713f-abc8-4923-b4a1-3abf8d2048b1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:19.054218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6d60713f-abc8-4923-b4a1-3abf8d2048b1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:19.192707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6d60713f-abc8-4923-b4a1-3abf8d2048b1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:19.200300 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6d60713f-abc8-4923-b4a1-3abf8d2048b1 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1518 microversion: 2.1 time: 0.161062 Aug 18 11:08:19.201133 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 320/651] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:19 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:19.563752 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:19.564365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:19.571085 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:19.571572 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:19.572082 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:19.572714 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:19.573163 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:19.573606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:19.713199 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-da889ed4-d113-4d79-8d6f-37cdd700b2a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:19.713954 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-da889ed4-d113-4d79-8d6f-37cdd700b2a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:19.715454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:19.722623 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da889ed4-d113-4d79-8d6f-37cdd700b2a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:19.723263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da889ed4-d113-4d79-8d6f-37cdd700b2a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:19.723749 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da889ed4-d113-4d79-8d6f-37cdd700b2a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:19.724562 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da889ed4-d113-4d79-8d6f-37cdd700b2a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:19.724674 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:19.725135 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da889ed4-d113-4d79-8d6f-37cdd700b2a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:19.725659 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-da889ed4-d113-4d79-8d6f-37cdd700b2a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:19.726135 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:19.727370 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0f5d2bef-c1ee-4833-b736-543e32bcb207 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.168120 Aug 18 11:08:19.728112 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 332/652] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:19 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:19.870060 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-da889ed4-d113-4d79-8d6f-37cdd700b2a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:19.878417 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-da889ed4-d113-4d79-8d6f-37cdd700b2a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1364 microversion: 2.1 time: 0.171256 Aug 18 11:08:19.878988 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 321/653] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:19 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:20.222641 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a5b48f46-d071-43a4-8ad6-42efa2fd7921 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:20.223252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a5b48f46-d071-43a4-8ad6-42efa2fd7921 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:20.229475 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a5b48f46-d071-43a4-8ad6-42efa2fd7921 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:20.229998 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a5b48f46-d071-43a4-8ad6-42efa2fd7921 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:20.230471 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a5b48f46-d071-43a4-8ad6-42efa2fd7921 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:20.231315 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a5b48f46-d071-43a4-8ad6-42efa2fd7921 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:20.231770 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a5b48f46-d071-43a4-8ad6-42efa2fd7921 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:20.232199 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a5b48f46-d071-43a4-8ad6-42efa2fd7921 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:20.386266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a5b48f46-d071-43a4-8ad6-42efa2fd7921 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:20.394054 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a5b48f46-d071-43a4-8ad6-42efa2fd7921 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1520 microversion: 2.1 time: 0.176195 Aug 18 11:08:20.395118 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 333/654] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:20 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:20.750811 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:20.751521 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:20.758015 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:20.758510 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:20.758955 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:20.759659 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:20.760116 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:20.760547 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:20.900710 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-aeb5bd12-4cf5-4c5e-ad40-1ce63e2aa5a2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:20.901987 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-aeb5bd12-4cf5-4c5e-ad40-1ce63e2aa5a2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:20.910938 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aeb5bd12-4cf5-4c5e-ad40-1ce63e2aa5a2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:20.911716 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aeb5bd12-4cf5-4c5e-ad40-1ce63e2aa5a2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:20.912357 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aeb5bd12-4cf5-4c5e-ad40-1ce63e2aa5a2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:20.913372 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aeb5bd12-4cf5-4c5e-ad40-1ce63e2aa5a2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:20.914021 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aeb5bd12-4cf5-4c5e-ad40-1ce63e2aa5a2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:20.914637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-aeb5bd12-4cf5-4c5e-ad40-1ce63e2aa5a2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:20.982601 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:20.992975 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:20.994522 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:20.995702 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fa107e92-f797-4ef6-ac09-43eaf264ac1f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.249372 Aug 18 11:08:20.996350 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 322/655] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:20 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:21.074590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-aeb5bd12-4cf5-4c5e-ad40-1ce63e2aa5a2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:21.082997 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-aeb5bd12-4cf5-4c5e-ad40-1ce63e2aa5a2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1364 microversion: 2.1 time: 0.187430 Aug 18 11:08:21.083581 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 334/656] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:20 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:21.416334 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3593a12f-8f62-4c27-b2e8-bea6edc9b51c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:21.416862 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3593a12f-8f62-4c27-b2e8-bea6edc9b51c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:21.423281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3593a12f-8f62-4c27-b2e8-bea6edc9b51c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:21.423766 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3593a12f-8f62-4c27-b2e8-bea6edc9b51c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:21.424200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3593a12f-8f62-4c27-b2e8-bea6edc9b51c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:21.424890 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3593a12f-8f62-4c27-b2e8-bea6edc9b51c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:21.425343 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3593a12f-8f62-4c27-b2e8-bea6edc9b51c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:21.425790 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3593a12f-8f62-4c27-b2e8-bea6edc9b51c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:21.556604 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-3593a12f-8f62-4c27-b2e8-bea6edc9b51c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:21.564661 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3593a12f-8f62-4c27-b2e8-bea6edc9b51c tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1576 microversion: 2.1 time: 0.152270 Aug 18 11:08:21.565223 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 323/657] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:21 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:22.020104 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:22.020720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:22.027305 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:22.027787 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:22.028227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:22.028953 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:22.029412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:22.029877 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:22.104699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-eb00fb59-44bd-4670-84d9-71fefe225975 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:22.105314 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-eb00fb59-44bd-4670-84d9-71fefe225975 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:22.107645 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:22.113753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eb00fb59-44bd-4670-84d9-71fefe225975 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:22.114245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eb00fb59-44bd-4670-84d9-71fefe225975 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:22.114681 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eb00fb59-44bd-4670-84d9-71fefe225975 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:22.115377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eb00fb59-44bd-4670-84d9-71fefe225975 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:22.115829 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eb00fb59-44bd-4670-84d9-71fefe225975 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:22.116255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eb00fb59-44bd-4670-84d9-71fefe225975 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:22.120621 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=10 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:22.163998 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:22.172848 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:22.174379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:22.175530 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bcbfc77f-7dda-495a-84d1-ea7e0a1c6f3b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.159447 Aug 18 11:08:22.176086 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 335/658] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:22 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:22.253009 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-eb00fb59-44bd-4670-84d9-71fefe225975 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:22.260467 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-eb00fb59-44bd-4670-84d9-71fefe225975 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1364 microversion: 2.1 time: 0.159587 Aug 18 11:08:22.261025 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 324/659] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:22 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:22.585484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bfae52f3-7b09-43ea-a5c2-dca56fe0e1b7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:22.586112 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bfae52f3-7b09-43ea-a5c2-dca56fe0e1b7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:22.587928 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:22.594244 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bfae52f3-7b09-43ea-a5c2-dca56fe0e1b7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:22.594736 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bfae52f3-7b09-43ea-a5c2-dca56fe0e1b7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:22.595184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bfae52f3-7b09-43ea-a5c2-dca56fe0e1b7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:22.595858 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bfae52f3-7b09-43ea-a5c2-dca56fe0e1b7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:22.596311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bfae52f3-7b09-43ea-a5c2-dca56fe0e1b7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:22.596732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bfae52f3-7b09-43ea-a5c2-dca56fe0e1b7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:22.733485 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bfae52f3-7b09-43ea-a5c2-dca56fe0e1b7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:22.742277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bfae52f3-7b09-43ea-a5c2-dca56fe0e1b7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1576 microversion: 2.1 time: 0.160528 Aug 18 11:08:22.742898 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 336/660] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:22 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:22.823998 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-91029e60-23e7-4afd-b33e-5add8219e90f req-79faf7a7-30c6-4c35-a3a4-64b6763d720b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4584500a-8d03-4227-ac47-c7ea8b80d2ce", "name": "network-vif-plugged", "status": "completed", "tag": "b0d5a80e-61c6-406b-b831-5f20d3e9500b"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:22.834589 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-91029e60-23e7-4afd-b33e-5add8219e90f req-79faf7a7-30c6-4c35-a3a4-64b6763d720b service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:22.835109 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-91029e60-23e7-4afd-b33e-5add8219e90f req-79faf7a7-30c6-4c35-a3a4-64b6763d720b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:22.835676 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-91029e60-23e7-4afd-b33e-5add8219e90f req-79faf7a7-30c6-4c35-a3a4-64b6763d720b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:22.847045 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-91029e60-23e7-4afd-b33e-5add8219e90f req-79faf7a7-30c6-4c35-a3a4-64b6763d720b service nova] Creating event network-vif-plugged:b0d5a80e-61c6-406b-b831-5f20d3e9500b for instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce on hv-cinder-82660 Aug 18 11:08:22.852070 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-91029e60-23e7-4afd-b33e-5add8219e90f req-79faf7a7-30c6-4c35-a3a4-64b6763d720b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031786 Aug 18 11:08:22.852823 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 325/661] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:23.198294 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:23.198896 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:23.205850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:23.206332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:23.206762 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:23.207454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:23.207901 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:23.208316 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:23.282136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8a4c65ad-3c2e-4ab4-8677-7420f69f71da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:23.282750 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8a4c65ad-3c2e-4ab4-8677-7420f69f71da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:23.289434 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a4c65ad-3c2e-4ab4-8677-7420f69f71da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:23.290548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a4c65ad-3c2e-4ab4-8677-7420f69f71da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:23.290985 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a4c65ad-3c2e-4ab4-8677-7420f69f71da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:23.291711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a4c65ad-3c2e-4ab4-8677-7420f69f71da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:23.292159 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a4c65ad-3c2e-4ab4-8677-7420f69f71da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:23.292575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8a4c65ad-3c2e-4ab4-8677-7420f69f71da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:23.341168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:23.349867 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:23.351374 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:23.352535 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a9957878-1295-4993-a3de-0abe09435678 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.158091 Aug 18 11:08:23.353590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 337/662] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:23 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:23.430958 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8a4c65ad-3c2e-4ab4-8677-7420f69f71da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:23.439123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8a4c65ad-3c2e-4ab4-8677-7420f69f71da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1364 microversion: 2.1 time: 0.161391 Aug 18 11:08:23.439693 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 326/663] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:23 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:23.764851 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-96d80665-b612-4a56-8b2f-3c7f448af485 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:23.765455 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-96d80665-b612-4a56-8b2f-3c7f448af485 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:23.771359 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-96d80665-b612-4a56-8b2f-3c7f448af485 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:23.771840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-96d80665-b612-4a56-8b2f-3c7f448af485 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:23.772272 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-96d80665-b612-4a56-8b2f-3c7f448af485 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:23.772956 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-96d80665-b612-4a56-8b2f-3c7f448af485 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:23.773410 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-96d80665-b612-4a56-8b2f-3c7f448af485 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:23.773852 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-96d80665-b612-4a56-8b2f-3c7f448af485 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:23.910372 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-96d80665-b612-4a56-8b2f-3c7f448af485 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:23.918097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-96d80665-b612-4a56-8b2f-3c7f448af485 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1576 microversion: 2.1 time: 0.156977 Aug 18 11:08:23.918939 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 338/664] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:23 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:24.378978 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:24.380241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:24.388013 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:24.388508 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:24.388945 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:24.389703 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:24.390264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:24.390695 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:24.460209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f3214eed-ead2-4f4e-97a0-1f63692d179e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:24.460743 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f3214eed-ead2-4f4e-97a0-1f63692d179e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:24.467492 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f3214eed-ead2-4f4e-97a0-1f63692d179e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:24.468790 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f3214eed-ead2-4f4e-97a0-1f63692d179e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:24.469364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f3214eed-ead2-4f4e-97a0-1f63692d179e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:24.470125 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f3214eed-ead2-4f4e-97a0-1f63692d179e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:24.470587 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f3214eed-ead2-4f4e-97a0-1f63692d179e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:24.471014 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f3214eed-ead2-4f4e-97a0-1f63692d179e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:24.629485 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f3214eed-ead2-4f4e-97a0-1f63692d179e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:24.637234 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f3214eed-ead2-4f4e-97a0-1f63692d179e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1550 microversion: 2.1 time: 0.181011 Aug 18 11:08:24.637986 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 339/665] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:24 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1550 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:24.658847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8ceae675-514b-4dfd-9694-e9d80e2c2388 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:24.659362 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8ceae675-514b-4dfd-9694-e9d80e2c2388 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:24.665826 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8ceae675-514b-4dfd-9694-e9d80e2c2388 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:24.666319 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8ceae675-514b-4dfd-9694-e9d80e2c2388 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:24.666753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8ceae675-514b-4dfd-9694-e9d80e2c2388 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:24.667462 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8ceae675-514b-4dfd-9694-e9d80e2c2388 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:24.667913 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8ceae675-514b-4dfd-9694-e9d80e2c2388 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:24.668578 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8ceae675-514b-4dfd-9694-e9d80e2c2388 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:24.686051 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:24.753683 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8ceae675-514b-4dfd-9694-e9d80e2c2388 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099160 Aug 18 11:08:24.754281 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 340/666] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Aug 18 11:08:24 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:08:24.760572 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:24.770225 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:24.771757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:24.772930 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-14150caa-0024-47a0-9f6c-e96e4c0b1e64 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.398124 Aug 18 11:08:24.773492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 327/667] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:24 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:08:24.924923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-6dba0b6b-c455-4776-b093-ea9ca3424aad req-467bf0bf-8b17-49fb-a97d-d9873b5e254a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192f88e2-9697-4492-ac5f-83e871070136", "name": "network-vif-unplugged", "status": "completed", "tag": "8f8c3d63-26c6-4e2b-9922-666ae0de919b"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:24.935058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6dba0b6b-c455-4776-b093-ea9ca3424aad req-467bf0bf-8b17-49fb-a97d-d9873b5e254a service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:24.935618 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6dba0b6b-c455-4776-b093-ea9ca3424aad req-467bf0bf-8b17-49fb-a97d-d9873b5e254a service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:24.936231 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6dba0b6b-c455-4776-b093-ea9ca3424aad req-467bf0bf-8b17-49fb-a97d-d9873b5e254a service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:24.941360 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0f47fbea-8fe9-46ea-9a7c-4d230505a6df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:24.942288 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0f47fbea-8fe9-46ea-9a7c-4d230505a6df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:24.948692 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-6dba0b6b-c455-4776-b093-ea9ca3424aad req-467bf0bf-8b17-49fb-a97d-d9873b5e254a service nova] Creating event network-vif-unplugged:8f8c3d63-26c6-4e2b-9922-666ae0de919b for instance 192f88e2-9697-4492-ac5f-83e871070136 on hv-cinder-82660 Aug 18 11:08:24.949427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f47fbea-8fe9-46ea-9a7c-4d230505a6df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:24.950010 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f47fbea-8fe9-46ea-9a7c-4d230505a6df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:24.950515 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f47fbea-8fe9-46ea-9a7c-4d230505a6df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:24.951284 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f47fbea-8fe9-46ea-9a7c-4d230505a6df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:24.951803 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f47fbea-8fe9-46ea-9a7c-4d230505a6df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:24.953563 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0f47fbea-8fe9-46ea-9a7c-4d230505a6df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:24.954258 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-6dba0b6b-c455-4776-b093-ea9ca3424aad req-467bf0bf-8b17-49fb-a97d-d9873b5e254a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087126 Aug 18 11:08:24.955073 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 341/668] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:08:25.195828 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0f47fbea-8fe9-46ea-9a7c-4d230505a6df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:25.204355 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0f47fbea-8fe9-46ea-9a7c-4d230505a6df tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1576 microversion: 2.1 time: 0.267812 Aug 18 11:08:25.215226 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 328/669] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:24 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:25.789717 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-54f06342-0c74-4f7f-8374-1ca24998e92a req-31575b16-9aff-43a0-838f-4e4d1149f55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4584500a-8d03-4227-ac47-c7ea8b80d2ce", "tag": "b0d5a80e-61c6-406b-b831-5f20d3e9500b"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:25.797682 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:25.798289 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:25.801689 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-54f06342-0c74-4f7f-8374-1ca24998e92a req-31575b16-9aff-43a0-838f-4e4d1149f55c service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:25.801982 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-54f06342-0c74-4f7f-8374-1ca24998e92a req-31575b16-9aff-43a0-838f-4e4d1149f55c service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:25.802479 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-54f06342-0c74-4f7f-8374-1ca24998e92a req-31575b16-9aff-43a0-838f-4e4d1149f55c service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:25.804723 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:25.805206 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:25.805671 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:25.807052 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:25.807052 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:25.807272 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:25.816484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-54f06342-0c74-4f7f-8374-1ca24998e92a req-31575b16-9aff-43a0-838f-4e4d1149f55c service nova] Creating event network-changed:b0d5a80e-61c6-406b-b831-5f20d3e9500b for instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce on hv-cinder-82660 Aug 18 11:08:25.822712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-54f06342-0c74-4f7f-8374-1ca24998e92a req-31575b16-9aff-43a0-838f-4e4d1149f55c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036652 Aug 18 11:08:25.823407 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 342/670] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:26.037197 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:26.047342 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:26.049504 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:26.050804 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-62838002-d49d-48db-a309-ceb84f3c61e0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.258083 Aug 18 11:08:26.051748 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 329/671] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:25 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:26.227972 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a1ba2624-14d3-4f5a-9b16-245b40f6ccc3 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:26.228723 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a1ba2624-14d3-4f5a-9b16-245b40f6ccc3 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:26.235091 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1ba2624-14d3-4f5a-9b16-245b40f6ccc3 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:26.235572 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1ba2624-14d3-4f5a-9b16-245b40f6ccc3 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:26.236089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1ba2624-14d3-4f5a-9b16-245b40f6ccc3 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:26.236804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1ba2624-14d3-4f5a-9b16-245b40f6ccc3 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:26.237181 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1ba2624-14d3-4f5a-9b16-245b40f6ccc3 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:26.237645 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a1ba2624-14d3-4f5a-9b16-245b40f6ccc3 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:26.388077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a1ba2624-14d3-4f5a-9b16-245b40f6ccc3 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:26.399829 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a1ba2624-14d3-4f5a-9b16-245b40f6ccc3 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1576 microversion: 2.1 time: 0.175781 Aug 18 11:08:26.401097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 343/672] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:26 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:27.074606 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:27.075235 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:27.081865 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:27.082375 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:27.082836 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:27.083571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:27.084056 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:27.084511 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:27.102841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=100 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:27.222608 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:27.230619 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:27.232165 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:27.233951 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5e36f811-cc2f-4a3f-80e8-148a4786f355 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.162969 Aug 18 11:08:27.234657 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 330/673] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:27 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:27.423036 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-339fdf9a-2566-45f3-960b-6623b31b6b23 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:27.423620 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-339fdf9a-2566-45f3-960b-6623b31b6b23 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:27.431180 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-339fdf9a-2566-45f3-960b-6623b31b6b23 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:27.431657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-339fdf9a-2566-45f3-960b-6623b31b6b23 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:27.432085 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-339fdf9a-2566-45f3-960b-6623b31b6b23 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:27.432781 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-339fdf9a-2566-45f3-960b-6623b31b6b23 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:27.433227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-339fdf9a-2566-45f3-960b-6623b31b6b23 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:27.433679 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-339fdf9a-2566-45f3-960b-6623b31b6b23 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:27.576359 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-339fdf9a-2566-45f3-960b-6623b31b6b23 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:27.584442 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-339fdf9a-2566-45f3-960b-6623b31b6b23 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1576 microversion: 2.1 time: 0.166723 Aug 18 11:08:27.585008 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 344/674] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:27 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:28.257058 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:28.257703 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:28.264097 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:28.264621 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:28.265096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:28.265819 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:28.266273 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:28.266703 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:28.397683 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:28.406777 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:28.408306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:28.409481 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-77a17546-8e8d-4516-a126-bb2a73bcc152 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.156449 Aug 18 11:08:28.410073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 331/675] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:28 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:28.606372 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bafe5b4c-8f29-4cc2-a19f-a62e0de3f3f9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:28.606975 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bafe5b4c-8f29-4cc2-a19f-a62e0de3f3f9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:28.613441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bafe5b4c-8f29-4cc2-a19f-a62e0de3f3f9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:28.613953 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bafe5b4c-8f29-4cc2-a19f-a62e0de3f3f9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:28.614392 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bafe5b4c-8f29-4cc2-a19f-a62e0de3f3f9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:28.615082 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bafe5b4c-8f29-4cc2-a19f-a62e0de3f3f9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:28.615524 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bafe5b4c-8f29-4cc2-a19f-a62e0de3f3f9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:28.615941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bafe5b4c-8f29-4cc2-a19f-a62e0de3f3f9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:28.753307 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bafe5b4c-8f29-4cc2-a19f-a62e0de3f3f9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:28.760698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bafe5b4c-8f29-4cc2-a19f-a62e0de3f3f9 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1576 microversion: 2.1 time: 0.158173 Aug 18 11:08:28.761253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 345/676] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:28 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:08:29.432920 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:29.433577 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:29.440524 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:29.441007 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:29.441442 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:29.442162 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:29.442609 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:29.443036 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:29.571614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:29.581122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:29.582758 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:29.583915 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b8523b69-d34f-4afa-b647-f020e3f04bd0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.154928 Aug 18 11:08:29.584475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 332/677] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:29 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:29.783772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8bec9189-2067-4dd5-9a72-24dbdfce94c8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:29.784314 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8bec9189-2067-4dd5-9a72-24dbdfce94c8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:29.791104 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8bec9189-2067-4dd5-9a72-24dbdfce94c8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:29.791592 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8bec9189-2067-4dd5-9a72-24dbdfce94c8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:29.792030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8bec9189-2067-4dd5-9a72-24dbdfce94c8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:29.792727 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8bec9189-2067-4dd5-9a72-24dbdfce94c8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:29.793183 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8bec9189-2067-4dd5-9a72-24dbdfce94c8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:29.793900 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8bec9189-2067-4dd5-9a72-24dbdfce94c8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:29.935184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8bec9189-2067-4dd5-9a72-24dbdfce94c8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:29.947309 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8bec9189-2067-4dd5-9a72-24dbdfce94c8 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1563 microversion: 2.1 time: 0.167908 Aug 18 11:08:29.947885 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 346/678] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:08:29 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:08:30.606762 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:30.607359 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:30.614018 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:30.614496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:30.614923 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:30.615611 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:30.616057 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:30.616476 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:30.756204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:30.764103 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:30.766203 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:30.767361 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d4f02d19-2a6d-4794-a99d-33494e6fa369 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.164479 Aug 18 11:08:30.767917 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 333/679] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:30 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:31.791252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:31.791861 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:31.799934 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:31.800433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:31.800871 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:31.801621 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:31.802078 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:31.802505 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:31.937229 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:31.945641 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:31.947165 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:31.948327 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5309c80a-b172-4061-8625-f29cd2a2ecf7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.161119 Aug 18 11:08:31.948880 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 347/680] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:31 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:32.831819 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-ca7f9f5c-3275-460b-999b-cac525549101 req-e5e830b3-1012-491e-85a9-2c202716c182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192f88e2-9697-4492-ac5f-83e871070136", "name": "network-vif-plugged", "status": "completed", "tag": "8f8c3d63-26c6-4e2b-9922-666ae0de919b"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:32.843015 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-ca7f9f5c-3275-460b-999b-cac525549101 req-e5e830b3-1012-491e-85a9-2c202716c182 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:32.843723 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-ca7f9f5c-3275-460b-999b-cac525549101 req-e5e830b3-1012-491e-85a9-2c202716c182 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:32.844261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-ca7f9f5c-3275-460b-999b-cac525549101 req-e5e830b3-1012-491e-85a9-2c202716c182 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:32.856008 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-ca7f9f5c-3275-460b-999b-cac525549101 req-e5e830b3-1012-491e-85a9-2c202716c182 service nova] Creating event network-vif-plugged:8f8c3d63-26c6-4e2b-9922-666ae0de919b for instance 192f88e2-9697-4492-ac5f-83e871070136 on hv-cinder-82660 Aug 18 11:08:32.861870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-ca7f9f5c-3275-460b-999b-cac525549101 req-e5e830b3-1012-491e-85a9-2c202716c182 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033866 Aug 18 11:08:32.862855 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 334/681] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:32.971346 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:32.971956 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:32.978641 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:32.979125 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:32.979575 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:32.980267 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:32.980720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:32.981147 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:33.116515 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:33.126070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:33.127647 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:33.128834 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-06cb588b-eecc-4113-b9a0-5932be5281c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1745 microversion: 2.20 time: 0.161500 Aug 18 11:08:33.129396 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 348/682] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:32 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:34.154682 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:34.155844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:34.165106 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:34.165622 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:34.166066 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:34.166758 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:34.167215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:34.167650 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:34.314838 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:34.322686 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:34.324175 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:34.325341 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9106a4ff-24a2-4a1a-9999-33278eecc6a6 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1745 microversion: 2.20 time: 0.175862 Aug 18 11:08:34.325975 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 335/683] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:34 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:35.347422 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:35.348425 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:35.355487 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:35.355976 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:35.356564 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:35.357441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:35.358077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:35.358509 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:35.513242 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:35.526162 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:35.528267 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:35.529502 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a8da8193-d119-46e6-aaa1-a35ee91381c5 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1740 microversion: 2.20 time: 0.186241 Aug 18 11:08:35.530536 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 349/684] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:35 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:36.556087 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:36.556719 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:36.564975 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:36.565497 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:36.565997 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:36.566782 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:36.567431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:36.568044 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:36.715438 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:36.753070 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:36.755929 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:36.757238 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e1fd75e0-9a64-4448-a7c1-6e14f167cc88 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1740 microversion: 2.20 time: 0.205143 Aug 18 11:08:36.772810 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 336/685] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:36 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:36.929360 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-d63c43b1-837d-4a26-8d0b-29740f6d5711 req-d466f3c0-6dda-41da-8e29-fc35a49b3aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5aa4f6f-cb29-46ab-b558-e91195e757fc", "name": "network-vif-plugged", "status": "completed", "tag": "b6d81a7c-88f7-44ae-a304-da843f87fdd7"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:36.951331 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-d63c43b1-837d-4a26-8d0b-29740f6d5711 req-d466f3c0-6dda-41da-8e29-fc35a49b3aa5 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:36.952176 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-d63c43b1-837d-4a26-8d0b-29740f6d5711 req-d466f3c0-6dda-41da-8e29-fc35a49b3aa5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:36.952845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-d63c43b1-837d-4a26-8d0b-29740f6d5711 req-d466f3c0-6dda-41da-8e29-fc35a49b3aa5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:36.965289 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-d63c43b1-837d-4a26-8d0b-29740f6d5711 req-d466f3c0-6dda-41da-8e29-fc35a49b3aa5 service nova] Creating event network-vif-plugged:b6d81a7c-88f7-44ae-a304-da843f87fdd7 for instance a5aa4f6f-cb29-46ab-b558-e91195e757fc on hv-cinder-82660 Aug 18 11:08:36.971028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-d63c43b1-837d-4a26-8d0b-29740f6d5711 req-d466f3c0-6dda-41da-8e29-fc35a49b3aa5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046002 Aug 18 11:08:36.971932 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 350/686] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:37.779802 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:37.781712 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:37.788590 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:37.789086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:37.789557 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:37.790291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:37.790754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:37.791186 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:37.938517 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:37.947241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:37.948842 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:37.950012 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-00e33dfe-810d-49e2-9eac-025a2c438a1d tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1740 microversion: 2.20 time: 0.174140 Aug 18 11:08:37.950579 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 337/687] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:37 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:38.975813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:38.976571 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:38.982978 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:38.983769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:38.984201 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:38.984911 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:38.985364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:38.985809 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:39.133834 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:39.144071 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:39.146296 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:39.148209 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f54306a2-ebfa-4b69-8315-a333916baa54 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1740 microversion: 2.20 time: 0.177013 Aug 18 11:08:39.149069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 351/688] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:38 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:40.173922 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:40.174440 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:40.181987 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:40.182649 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:40.183237 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:40.184265 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:40.185101 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:40.185782 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:40.353608 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:40.364684 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:40.366449 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:40.367771 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8436e864-2f83-46af-a94d-ca9236de75c7 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1740 microversion: 2.20 time: 0.199343 Aug 18 11:08:40.381543 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 338/689] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:40 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:41.300877 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3be4ea40-b070-422d-af48-c2578eea7b0e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:41.301449 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3be4ea40-b070-422d-af48-c2578eea7b0e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:41.308542 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3be4ea40-b070-422d-af48-c2578eea7b0e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:41.309109 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3be4ea40-b070-422d-af48-c2578eea7b0e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:41.309605 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3be4ea40-b070-422d-af48-c2578eea7b0e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:41.310239 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3be4ea40-b070-422d-af48-c2578eea7b0e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:41.310688 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3be4ea40-b070-422d-af48-c2578eea7b0e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:41.311367 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3be4ea40-b070-422d-af48-c2578eea7b0e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:41.337865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3be4ea40-b070-422d-af48-c2578eea7b0e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/ips" status: 200 len: 149 microversion: 2.1 time: 0.040772 Aug 18 11:08:41.339891 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 352/690] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Aug 18 11:08:41 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:41.395098 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:41.395786 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:41.402157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:41.402743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:41.403609 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:41.404266 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:41.405067 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:41.405743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:41.579274 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:41.587956 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:41.590002 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:41.591590 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fe85c8bd-ffb6-400b-b040-e52be82d1dfc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1740 microversion: 2.20 time: 0.202503 Aug 18 11:08:41.606224 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 339/691] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:41 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:42.621679 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:42.622408 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:42.630579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:42.631369 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:42.632672 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:42.633813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:42.634555 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:42.635315 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:42.783878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7dd9fff7-7227-4ce3-bbc3-a978f6520a83 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab850f12-0fe7-4113-bc3c-55abb7bdb3f4"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:42.787198 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7dd9fff7-7227-4ce3-bbc3-a978f6520a83 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:42.794105 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7dd9fff7-7227-4ce3-bbc3-a978f6520a83 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:42.794871 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7dd9fff7-7227-4ce3-bbc3-a978f6520a83 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:42.795713 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7dd9fff7-7227-4ce3-bbc3-a978f6520a83 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:42.797218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7dd9fff7-7227-4ce3-bbc3-a978f6520a83 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:42.797892 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7dd9fff7-7227-4ce3-bbc3-a978f6520a83 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:42.798484 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7dd9fff7-7227-4ce3-bbc3-a978f6520a83 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:42.809427 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:42.820785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:42.823031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:42.824873 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3bdab07b-2f6a-4fcf-82c2-92d46c5b714a tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1740 microversion: 2.20 time: 0.207040 Aug 18 11:08:42.836161 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 353/692] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:42 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:43.114567 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7dd9fff7-7227-4ce3-bbc3-a978f6520a83 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "POST /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335893 Aug 18 11:08:43.124117 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 340/693] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:08:42 2022] POST /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:43.852630 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:43.853448 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:43.860187 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:43.860686 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:43.861114 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:43.861833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:43.862464 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:43.862889 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:44.022336 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:44.032291 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:44.035022 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:44.036431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b705e94b-b940-43a0-a5e8-740af06632a0 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1740 microversion: 2.20 time: 0.189778 Aug 18 11:08:44.036990 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 354/694] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:43 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:45.061303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:45.061967 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:45.069115 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:45.069643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:45.070087 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:45.070813 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:45.071276 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:45.071705 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:45.292130 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:45.304621 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:45.306465 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:45.308135 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fc5ddb53-a985-41ab-bb13-e73427318ebf tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1722 microversion: 2.20 time: 0.251055 Aug 18 11:08:45.308851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 341/695] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:45 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:46.333725 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:46.334328 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:46.340751 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:46.341257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:46.341718 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:46.343326 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:46.343829 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:46.344292 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:46.710956 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:46.719277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:46.720770 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:46.722003 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a3b3ff43-05b5-40fc-a851-ba4f3429f482 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1722 microversion: 2.20 time: 0.392988 Aug 18 11:08:46.722549 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 355/696] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:46 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:47.746117 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:47.746759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:47.753446 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:47.753939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:47.754375 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:47.755094 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:47.755634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:47.756060 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:47.901493 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:47.911069 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:47.912611 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:47.913917 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1da0f520-a247-4b28-9414-3f1dcd94594e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1725 microversion: 2.20 time: 0.171541 Aug 18 11:08:47.914895 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 342/697] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:47 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:47.939123 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0dff4163-4e7e-4267-b0a7-71fb5d8db624 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7d801a6-f2cf-4eca-a65d-13c0190adee4"}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:47.941471 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0dff4163-4e7e-4267-b0a7-71fb5d8db624 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:47.948267 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0dff4163-4e7e-4267-b0a7-71fb5d8db624 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:47.948753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0dff4163-4e7e-4267-b0a7-71fb5d8db624 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:47.949195 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0dff4163-4e7e-4267-b0a7-71fb5d8db624 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:47.949925 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0dff4163-4e7e-4267-b0a7-71fb5d8db624 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:47.950387 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0dff4163-4e7e-4267-b0a7-71fb5d8db624 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:47.950812 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0dff4163-4e7e-4267-b0a7-71fb5d8db624 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:48.240014 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0dff4163-4e7e-4267-b0a7-71fb5d8db624 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "POST /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305433 Aug 18 11:08:48.240646 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 356/698] 10.222.0.15 () {62 vars in 1364 bytes} [Thu Aug 18 11:08:47 2022] POST /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:08:48.368108 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7e7df547-c019-4831-93da-bc2a55afbbd2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:48.368601 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7e7df547-c019-4831-93da-bc2a55afbbd2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:48.375587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7e7df547-c019-4831-93da-bc2a55afbbd2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:48.376068 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7e7df547-c019-4831-93da-bc2a55afbbd2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:48.376507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7e7df547-c019-4831-93da-bc2a55afbbd2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:48.377202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7e7df547-c019-4831-93da-bc2a55afbbd2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:48.377677 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7e7df547-c019-4831-93da-bc2a55afbbd2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:48.378098 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7e7df547-c019-4831-93da-bc2a55afbbd2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:48.637287 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7e7df547-c019-4831-93da-bc2a55afbbd2 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/os-volume_attachments/c7d801a6-f2cf-4eca-a65d-13c0190adee4" status: 202 len: 0 microversion: 2.20 time: 0.273029 Aug 18 11:08:48.637982 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 343/699] 10.222.0.15 () {60 vars in 1457 bytes} [Thu Aug 18 11:08:48 2022] DELETE /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/os-volume_attachments/c7d801a6-f2cf-4eca-a65d-13c0190adee4 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:08:48.698396 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5f8e331f-3cba-4d97-abb8-3afd8008f7ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:48.698995 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5f8e331f-3cba-4d97-abb8-3afd8008f7ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:48.705704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f8e331f-3cba-4d97-abb8-3afd8008f7ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:48.706204 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f8e331f-3cba-4d97-abb8-3afd8008f7ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:48.706637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f8e331f-3cba-4d97-abb8-3afd8008f7ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:48.707343 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f8e331f-3cba-4d97-abb8-3afd8008f7ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:48.707800 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f8e331f-3cba-4d97-abb8-3afd8008f7ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:48.708227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5f8e331f-3cba-4d97-abb8-3afd8008f7ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:48.712217 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:48.741319 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5f8e331f-3cba-4d97-abb8-3afd8008f7ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120800) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 11:08:48.810289 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5f8e331f-3cba-4d97-abb8-3afd8008f7ff tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "POST /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/action" status: 202 len: 0 microversion: 2.20 time: 0.115795 Aug 18 11:08:48.811744 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 357/700] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Aug 18 11:08:48 2022] POST /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:08:48.821926 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:48.822628 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:48.827581 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=52 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:48.832246 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:48.832960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:48.833449 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:48.834549 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:48.835063 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:48.835584 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:48.841842 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:48.933922 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-0ee5b095-ecab-4b57-8c9d-ce8f1df8a3e5 req-8ed66148-3d10-4641-8f38-9c6a37cec4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5aa4f6f-cb29-46ab-b558-e91195e757fc", "name": "network-vif-unplugged", "status": "completed", "tag": "b6d81a7c-88f7-44ae-a304-da843f87fdd7"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:08:48.940822 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:08:48.953418 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0ee5b095-ecab-4b57-8c9d-ce8f1df8a3e5 req-8ed66148-3d10-4641-8f38-9c6a37cec4c4 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:48.954330 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0ee5b095-ecab-4b57-8c9d-ce8f1df8a3e5 req-8ed66148-3d10-4641-8f38-9c6a37cec4c4 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:48.955093 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0ee5b095-ecab-4b57-8c9d-ce8f1df8a3e5 req-8ed66148-3d10-4641-8f38-9c6a37cec4c4 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:48.970626 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.compute.server_external_events [req-0ee5b095-ecab-4b57-8c9d-ce8f1df8a3e5 req-8ed66148-3d10-4641-8f38-9c6a37cec4c4 service nova] Unable to find a host for instance a5aa4f6f-cb29-46ab-b558-e91195e757fc. Dropping event network-vif-unplugged {{(pid=120800) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 11:08:48.972196 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-0ee5b095-ecab-4b57-8c9d-ce8f1df8a3e5 req-8ed66148-3d10-4641-8f38-9c6a37cec4c4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042070 Aug 18 11:08:48.973420 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 358/701] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 18 11:08:49.003154 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:49.020076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:49.022058 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:49.023255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-bf84e4f9-2c20-4c1a-998b-9caaff0f4c27 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1673 microversion: 2.20 time: 0.206110 Aug 18 11:08:49.023813 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 344/702] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:48 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1673 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:50.048343 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:50.049016 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:50.056862 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:50.057388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:50.057987 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:50.058892 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:50.059459 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:50.060001 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:50.208551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:50.218102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:50.219632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:50.221020 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7c3bc9ba-d174-4f6e-88b8-0baa22747aed tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.177580 Aug 18 11:08:50.221592 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 359/703] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:50 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:50.854467 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-663044e2-9228-4b34-9558-38649f052610 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:50.855081 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-663044e2-9228-4b34-9558-38649f052610 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:50.862492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-663044e2-9228-4b34-9558-38649f052610 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:50.862970 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-663044e2-9228-4b34-9558-38649f052610 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:50.863403 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-663044e2-9228-4b34-9558-38649f052610 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:50.864082 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-663044e2-9228-4b34-9558-38649f052610 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:50.864671 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-663044e2-9228-4b34-9558-38649f052610 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:50.865096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-663044e2-9228-4b34-9558-38649f052610 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:50.948930 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-663044e2-9228-4b34-9558-38649f052610 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lazy-loading 'services' on Instance uuid 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:08:51.032059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-663044e2-9228-4b34-9558-38649f052610 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments/ab850f12-0fe7-4113-bc3c-55abb7bdb3f4" status: 202 len: 0 microversion: 2.1 time: 0.181525 Aug 18 11:08:51.032711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 345/704] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:08:50 2022] DELETE /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments/ab850f12-0fe7-4113-bc3c-55abb7bdb3f4 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:08:51.041539 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a7511159-5653-44c1-8c9e-9572acd6b1eb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:51.044183 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a7511159-5653-44c1-8c9e-9572acd6b1eb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:51.050628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7511159-5653-44c1-8c9e-9572acd6b1eb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:51.051866 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7511159-5653-44c1-8c9e-9572acd6b1eb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:51.052600 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7511159-5653-44c1-8c9e-9572acd6b1eb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:51.053483 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7511159-5653-44c1-8c9e-9572acd6b1eb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:51.054073 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7511159-5653-44c1-8c9e-9572acd6b1eb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:51.054578 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a7511159-5653-44c1-8c9e-9572acd6b1eb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:51.094741 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a7511159-5653-44c1-8c9e-9572acd6b1eb tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057441 Aug 18 11:08:51.095582 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 360/705] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:08:51 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:51.245120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:51.246151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:51.254537 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:51.255773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:51.256218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:51.257092 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:51.257742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:51.258378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:51.442357 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:51.458021 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:51.460418 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:51.462325 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9b846176-d1d5-4c68-a64b-5dd4045c3296 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.221496 Aug 18 11:08:51.463086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 346/706] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:51 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:52.109073 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bdb2af5a-368e-4d63-93a9-6c607cfdb33c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:52.112429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bdb2af5a-368e-4d63-93a9-6c607cfdb33c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:52.123541 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdb2af5a-368e-4d63-93a9-6c607cfdb33c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:52.124045 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdb2af5a-368e-4d63-93a9-6c607cfdb33c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:52.124505 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdb2af5a-368e-4d63-93a9-6c607cfdb33c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:52.125453 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdb2af5a-368e-4d63-93a9-6c607cfdb33c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:52.126133 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdb2af5a-368e-4d63-93a9-6c607cfdb33c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:52.126715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bdb2af5a-368e-4d63-93a9-6c607cfdb33c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:52.170420 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bdb2af5a-368e-4d63-93a9-6c607cfdb33c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065797 Aug 18 11:08:52.171807 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 361/707] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:08:52 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:52.487853 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:52.488560 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:52.495163 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:52.495727 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:52.496287 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:52.497147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:52.497699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:52.498195 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:52.903179 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:52.914207 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:52.916101 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:52.917496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a4d5e0f4-4cf9-4597-bc0b-3e67285a74fb tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.434194 Aug 18 11:08:52.929563 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 347/708] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:52 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:53.184037 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fd58cd70-203d-4b08-b80e-8466442e262f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:53.186427 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fd58cd70-203d-4b08-b80e-8466442e262f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:53.195267 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd58cd70-203d-4b08-b80e-8466442e262f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:53.195766 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd58cd70-203d-4b08-b80e-8466442e262f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:53.196206 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd58cd70-203d-4b08-b80e-8466442e262f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:53.196917 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd58cd70-203d-4b08-b80e-8466442e262f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:53.197373 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd58cd70-203d-4b08-b80e-8466442e262f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:53.197828 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd58cd70-203d-4b08-b80e-8466442e262f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:53.240883 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fd58cd70-203d-4b08-b80e-8466442e262f tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060734 Aug 18 11:08:53.241667 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 362/709] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:08:53 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:53.941291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:53.941931 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:53.949657 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:53.950560 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:53.951129 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:53.952885 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:53.954299 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:53.955266 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:54.110634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:54.121033 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:54.122561 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:54.124359 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-90f804aa-cf0b-43fe-b725-79a98553cb19 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.186606 Aug 18 11:08:54.124928 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 348/710] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:53 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:54.254461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1c6d2179-b13e-4974-b168-aeee7ee83c1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:54.257681 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1c6d2179-b13e-4974-b168-aeee7ee83c1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:54.269332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c6d2179-b13e-4974-b168-aeee7ee83c1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:54.269863 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c6d2179-b13e-4974-b168-aeee7ee83c1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:54.270363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c6d2179-b13e-4974-b168-aeee7ee83c1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:54.271084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c6d2179-b13e-4974-b168-aeee7ee83c1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:54.271557 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c6d2179-b13e-4974-b168-aeee7ee83c1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:54.271979 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1c6d2179-b13e-4974-b168-aeee7ee83c1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:54.308204 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1c6d2179-b13e-4974-b168-aeee7ee83c1e tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057598 Aug 18 11:08:54.308849 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 363/711] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:08:54 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:55.149027 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:55.149767 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:55.158501 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:55.159000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:55.159449 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:55.160186 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:55.160622 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:55.161042 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:55.320649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f33b2653-8e2e-4cda-9d29-a32a8f694ed2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:55.322027 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:55.322853 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f33b2653-8e2e-4cda-9d29-a32a8f694ed2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:55.331015 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:55.339229 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:55.340470 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b59b7246-a282-4e68-9027-af9702db89f9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.196121 Aug 18 11:08:55.353583 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 349/712] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:55 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:55.353835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f33b2653-8e2e-4cda-9d29-a32a8f694ed2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:55.353835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f33b2653-8e2e-4cda-9d29-a32a8f694ed2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:55.353835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f33b2653-8e2e-4cda-9d29-a32a8f694ed2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:55.353835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f33b2653-8e2e-4cda-9d29-a32a8f694ed2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:55.354171 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f33b2653-8e2e-4cda-9d29-a32a8f694ed2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:55.354171 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f33b2653-8e2e-4cda-9d29-a32a8f694ed2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:55.387280 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f33b2653-8e2e-4cda-9d29-a32a8f694ed2 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070167 Aug 18 11:08:55.388103 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 364/713] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:08:55 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:08:56.364853 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:56.365659 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:56.373976 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:56.374668 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:56.375113 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:56.375828 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:56.376287 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:56.376714 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:56.400352 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-81107a97-aba6-4427-86bf-6cf9a918c028 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:56.402575 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-81107a97-aba6-4427-86bf-6cf9a918c028 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:56.410365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-81107a97-aba6-4427-86bf-6cf9a918c028 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:56.410846 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-81107a97-aba6-4427-86bf-6cf9a918c028 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:56.411277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-81107a97-aba6-4427-86bf-6cf9a918c028 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:56.411996 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-81107a97-aba6-4427-86bf-6cf9a918c028 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:56.412428 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-81107a97-aba6-4427-86bf-6cf9a918c028 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:56.412852 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-81107a97-aba6-4427-86bf-6cf9a918c028 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:56.446136 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-81107a97-aba6-4427-86bf-6cf9a918c028 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049567 Aug 18 11:08:56.446952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 365/714] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:08:56 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:08:56.531246 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:56.541771 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:56.544182 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:56.545845 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2c8ae791-3d3c-47ec-9e47-0766e6192f77 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.184742 Aug 18 11:08:56.546878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 350/715] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:56 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:57.459986 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2bf0fd2f-d7be-46fe-bd25-cd5d71357e08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:57.462111 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2bf0fd2f-d7be-46fe-bd25-cd5d71357e08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:57.468462 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2bf0fd2f-d7be-46fe-bd25-cd5d71357e08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:57.468947 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2bf0fd2f-d7be-46fe-bd25-cd5d71357e08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:57.469384 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2bf0fd2f-d7be-46fe-bd25-cd5d71357e08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:57.470113 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2bf0fd2f-d7be-46fe-bd25-cd5d71357e08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:57.470627 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2bf0fd2f-d7be-46fe-bd25-cd5d71357e08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:57.471117 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2bf0fd2f-d7be-46fe-bd25-cd5d71357e08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:57.504919 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2bf0fd2f-d7be-46fe-bd25-cd5d71357e08 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049033 Aug 18 11:08:57.509415 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 366/716] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:08:57 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:57.570114 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:57.570759 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:57.578426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:57.578947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:57.579382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:57.580094 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:57.580551 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:57.580977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:57.724551 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:57.734662 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:57.736235 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:57.737405 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d1f12630-61f5-4507-8f1f-80fdfa9fef8f tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.171201 Aug 18 11:08:57.737998 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 351/717] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:57 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:58.516901 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5e079b2b-4d7e-4118-937b-6352cf9c0f67 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:58.519238 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5e079b2b-4d7e-4118-937b-6352cf9c0f67 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:58.526269 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e079b2b-4d7e-4118-937b-6352cf9c0f67 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:58.526767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e079b2b-4d7e-4118-937b-6352cf9c0f67 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:58.527175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e079b2b-4d7e-4118-937b-6352cf9c0f67 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:58.527865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e079b2b-4d7e-4118-937b-6352cf9c0f67 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:58.528311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e079b2b-4d7e-4118-937b-6352cf9c0f67 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:58.528976 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e079b2b-4d7e-4118-937b-6352cf9c0f67 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:58.566493 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5e079b2b-4d7e-4118-937b-6352cf9c0f67 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053840 Aug 18 11:08:58.567084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 367/718] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:08:58 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:58.762391 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:58.763021 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:58.770514 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:58.770934 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:58.771374 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:58.772090 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:58.772539 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:58.772970 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:58.952995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:58.961099 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:58.962638 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:08:58.963960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fbff3a53-de9f-47d0-a4fb-fa1696191566 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.205406 Aug 18 11:08:58.964723 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 352/719] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:58 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:08:59.581645 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2cd7c475-70be-48fe-b1e9-4caf65d021d3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:59.583755 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2cd7c475-70be-48fe-b1e9-4caf65d021d3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:59.590266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cd7c475-70be-48fe-b1e9-4caf65d021d3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:59.590747 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cd7c475-70be-48fe-b1e9-4caf65d021d3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:59.591176 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cd7c475-70be-48fe-b1e9-4caf65d021d3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:59.591918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cd7c475-70be-48fe-b1e9-4caf65d021d3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:59.592588 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cd7c475-70be-48fe-b1e9-4caf65d021d3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:59.592776 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2cd7c475-70be-48fe-b1e9-4caf65d021d3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:59.623592 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2cd7c475-70be-48fe-b1e9-4caf65d021d3 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047814 Aug 18 11:08:59.624357 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 368/720] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:08:59 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:08:59.987996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:08:59.988626 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:08:59.995074 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:59.995549 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:59.995973 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:08:59.996655 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:08:59.997099 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:08:59.997545 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:00.131691 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:00.140284 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:00.141826 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:00.142976 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9087b964-d115-458c-a7b9-b5a2c1a6e22e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.158968 Aug 18 11:09:00.143534 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 353/721] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:08:59 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:00.635973 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-56771193-d353-4081-bca5-997968ad0e0c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:00.638218 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-56771193-d353-4081-bca5-997968ad0e0c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:00.645473 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-56771193-d353-4081-bca5-997968ad0e0c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:00.645993 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-56771193-d353-4081-bca5-997968ad0e0c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:00.646441 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-56771193-d353-4081-bca5-997968ad0e0c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:00.647136 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-56771193-d353-4081-bca5-997968ad0e0c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:00.647594 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-56771193-d353-4081-bca5-997968ad0e0c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:00.648057 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-56771193-d353-4081-bca5-997968ad0e0c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:00.678594 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-56771193-d353-4081-bca5-997968ad0e0c tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046935 Aug 18 11:09:00.679185 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 369/722] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:09:00 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:01.168155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:01.168882 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:01.178478 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:01.179113 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:01.179563 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:01.180275 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:01.180965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:01.181166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:01.403634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:01.413055 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:01.415157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:01.416318 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e5b260e0-2925-4968-95c9-58db494370a9 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.253214 Aug 18 11:09:01.417238 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 354/723] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:01 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:01.692075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fef617ff-72dd-48bb-adf7-bddc6031e7a1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:01.694388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fef617ff-72dd-48bb-adf7-bddc6031e7a1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:01.700537 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fef617ff-72dd-48bb-adf7-bddc6031e7a1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:01.701092 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fef617ff-72dd-48bb-adf7-bddc6031e7a1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:01.701632 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fef617ff-72dd-48bb-adf7-bddc6031e7a1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:01.702326 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fef617ff-72dd-48bb-adf7-bddc6031e7a1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:01.702772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fef617ff-72dd-48bb-adf7-bddc6031e7a1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:01.703193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fef617ff-72dd-48bb-adf7-bddc6031e7a1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:01.734018 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fef617ff-72dd-48bb-adf7-bddc6031e7a1 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044686 Aug 18 11:09:01.734529 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 370/724] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:09:01 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:09:01.798384 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3cadc39c-a92a-4091-93a5-0c7c79064f21 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:01.798878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3cadc39c-a92a-4091-93a5-0c7c79064f21 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:01.804786 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3cadc39c-a92a-4091-93a5-0c7c79064f21 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:01.805277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3cadc39c-a92a-4091-93a5-0c7c79064f21 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:01.805740 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3cadc39c-a92a-4091-93a5-0c7c79064f21 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:01.806450 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3cadc39c-a92a-4091-93a5-0c7c79064f21 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:01.806897 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3cadc39c-a92a-4091-93a5-0c7c79064f21 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:01.807316 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3cadc39c-a92a-4091-93a5-0c7c79064f21 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:01.832560 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3cadc39c-a92a-4091-93a5-0c7c79064f21 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:09:01.914289 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3cadc39c-a92a-4091-93a5-0c7c79064f21 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 204 len: 0 microversion: 2.1 time: 0.120430 Aug 18 11:09:01.914875 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 355/725] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:09:01 2022] DELETE /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:01.923942 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7c00df42-4fab-4ed6-afe0-3d17424067a5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:01.924562 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7c00df42-4fab-4ed6-afe0-3d17424067a5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:01.930600 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c00df42-4fab-4ed6-afe0-3d17424067a5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:01.931087 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c00df42-4fab-4ed6-afe0-3d17424067a5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:01.931523 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c00df42-4fab-4ed6-afe0-3d17424067a5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:01.932215 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c00df42-4fab-4ed6-afe0-3d17424067a5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:01.932671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c00df42-4fab-4ed6-afe0-3d17424067a5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:01.933096 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c00df42-4fab-4ed6-afe0-3d17424067a5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:02.065389 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7c00df42-4fab-4ed6-afe0-3d17424067a5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:02.072968 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7c00df42-4fab-4ed6-afe0-3d17424067a5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1681 microversion: 2.1 time: 0.153741 Aug 18 11:09:02.073555 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 371/726] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:01 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:02.442251 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:02.442863 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:02.449211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:02.449748 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:02.450187 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:02.450882 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:02.451451 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:02.452751 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:02.582293 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:02.590212 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:02.591716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:02.593281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f59ad1e2-6aa4-4a8d-a399-9101ec2bc860 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.156121 Aug 18 11:09:02.593888 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 356/727] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:02 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:03.096279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a3c51b3d-d739-4b24-b37c-032124fdaab0 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:03.097096 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a3c51b3d-d739-4b24-b37c-032124fdaab0 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:03.104089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3c51b3d-d739-4b24-b37c-032124fdaab0 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:03.104516 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3c51b3d-d739-4b24-b37c-032124fdaab0 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:03.104966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3c51b3d-d739-4b24-b37c-032124fdaab0 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:03.105776 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3c51b3d-d739-4b24-b37c-032124fdaab0 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:03.106217 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3c51b3d-d739-4b24-b37c-032124fdaab0 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:03.106666 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a3c51b3d-d739-4b24-b37c-032124fdaab0 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:03.276975 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a3c51b3d-d739-4b24-b37c-032124fdaab0 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:03.285468 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a3c51b3d-d739-4b24-b37c-032124fdaab0 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1681 microversion: 2.1 time: 0.194182 Aug 18 11:09:03.286098 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 372/728] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:03 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:03.616279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:03.616885 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:03.624313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:03.624815 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:03.625253 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:03.625988 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:03.626447 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:03.626869 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:03.765004 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:03.773091 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:03.774643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:03.775800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9d599cb6-ffc0-46d1-be64-c2085256d570 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.163492 Aug 18 11:09:03.776360 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 357/729] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:03 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:04.306475 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-99614366-45f9-405e-b16c-71ab6dd45b77 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:04.307081 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-99614366-45f9-405e-b16c-71ab6dd45b77 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:04.314358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99614366-45f9-405e-b16c-71ab6dd45b77 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:04.314838 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99614366-45f9-405e-b16c-71ab6dd45b77 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:04.315484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99614366-45f9-405e-b16c-71ab6dd45b77 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:04.316184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99614366-45f9-405e-b16c-71ab6dd45b77 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:04.316638 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99614366-45f9-405e-b16c-71ab6dd45b77 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:04.317057 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99614366-45f9-405e-b16c-71ab6dd45b77 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:04.335377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:04.458831 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-99614366-45f9-405e-b16c-71ab6dd45b77 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:04.466488 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-99614366-45f9-405e-b16c-71ab6dd45b77 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1681 microversion: 2.1 time: 0.163813 Aug 18 11:09:04.467183 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 373/730] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:04 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:04.800692 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:04.801277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:04.808204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:04.808755 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:04.809223 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:04.809992 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:04.810607 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:04.811292 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:04.829636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:05.008049 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-6e814007-39d3-4074-a3ed-62341eeaa995 req-9b282484-c557-4ff5-9678-b14c0ed84554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5aa4f6f-cb29-46ab-b558-e91195e757fc", "name": "network-vif-plugged", "status": "completed", "tag": "b6d81a7c-88f7-44ae-a304-da843f87fdd7"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:09:05.020306 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6e814007-39d3-4074-a3ed-62341eeaa995 req-9b282484-c557-4ff5-9678-b14c0ed84554 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:05.020910 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6e814007-39d3-4074-a3ed-62341eeaa995 req-9b282484-c557-4ff5-9678-b14c0ed84554 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:05.021939 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6e814007-39d3-4074-a3ed-62341eeaa995 req-9b282484-c557-4ff5-9678-b14c0ed84554 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:05.035590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-6e814007-39d3-4074-a3ed-62341eeaa995 req-9b282484-c557-4ff5-9678-b14c0ed84554 service nova] Creating event network-vif-plugged:b6d81a7c-88f7-44ae-a304-da843f87fdd7 for instance a5aa4f6f-cb29-46ab-b558-e91195e757fc on hv-cinder-82660 Aug 18 11:09:05.039194 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:05.048885 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:05.053137 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:05.054583 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-49a5499c-8482-4bcc-a10b-f55d2507ac06 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.257776 Aug 18 11:09:05.054751 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-6e814007-39d3-4074-a3ed-62341eeaa995 req-9b282484-c557-4ff5-9678-b14c0ed84554 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050167 Aug 18 11:09:05.070760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 374/731] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:09:05.071755 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 358/732] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:04 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:05.163771 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-07821e5c-7347-4f99-9562-9e2bdb4a5eee req-e5d1391c-1b93-4d07-89b5-9fad88eb2b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13", "name": "network-vif-deleted", "tag": "6c7b232e-13c7-4bc6-a2a8-aa7ab1248856"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:09:05.179053 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-07821e5c-7347-4f99-9562-9e2bdb4a5eee req-e5d1391c-1b93-4d07-89b5-9fad88eb2b9b service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:05.182565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-07821e5c-7347-4f99-9562-9e2bdb4a5eee req-e5d1391c-1b93-4d07-89b5-9fad88eb2b9b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:05.183255 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-07821e5c-7347-4f99-9562-9e2bdb4a5eee req-e5d1391c-1b93-4d07-89b5-9fad88eb2b9b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:05.210514 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-07821e5c-7347-4f99-9562-9e2bdb4a5eee req-e5d1391c-1b93-4d07-89b5-9fad88eb2b9b service nova] Creating event network-vif-deleted:6c7b232e-13c7-4bc6-a2a8-aa7ab1248856 for instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 on hv-cinder-82660 Aug 18 11:09:05.222759 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-07821e5c-7347-4f99-9562-9e2bdb4a5eee req-e5d1391c-1b93-4d07-89b5-9fad88eb2b9b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064245 Aug 18 11:09:05.223690 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 375/733] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:05.488826 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:05.489436 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:05.496119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:05.496609 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:05.497040 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:05.497784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:05.498413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:05.498989 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:05.532898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:05.533378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:05.533843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:05.534301 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lazy-loading 'fault' on Instance uuid 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:09:05.584709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e117589fc14e4d9d8d8494bddf9c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '397eac573c2d473e881b07c87255700c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:05.593220 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4cdcc0c0-9336-435c-a4bf-eef993480d85 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 200 len: 1331 microversion: 2.1 time: 0.108385 Aug 18 11:09:05.603830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 359/734] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:05 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:06.079708 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:06.080416 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:06.087364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:06.087870 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:06.088307 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:06.089016 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:06.089471 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:06.089941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:06.233845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:06.242704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:06.244214 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:06.245404 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9a4f0680-f962-428c-b445-62cdf8088e95 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.170674 Aug 18 11:09:06.245995 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 376/735] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:06 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:06.614621 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:06.615233 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:06.621728 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:06.622218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:06.622655 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:06.624350 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:06.624830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:06.625262 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:06.639168 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 HTTP/1.1 Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:09:06.640798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:06.642382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13'} Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:06.643155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:06.644643 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:06.646180 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:06.646180 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8fdacb95-1865-4037-883b-5330fdf432f6 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 404 len: 111 microversion: 2.1 time: 0.031538 Aug 18 11:09:06.646180 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 360/736] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:06 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:06.651540 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c002bc83-bc04-4426-8b63-1afaa6787e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '.version_select at 0x7f7ec8a5c670>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:06.671381 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c002bc83-bc04-4426-8b63-1afaa6787e99 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-756475826" status: 202 len: 0 microversion: 2.1 time: 0.023754 Aug 18 11:09:06.671961 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 377/737] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Aug 18 11:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-756475826 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:09:07.269028 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:07.269670 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:07.276179 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:07.277063 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:07.277861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:07.278823 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:07.280932 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:07.281688 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:07.447268 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:07.456732 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:07.458350 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:07.459530 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e850cc07-bea3-4eee-806c-fffb1709b765 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1731 microversion: 2.20 time: 0.195100 Aug 18 11:09:07.460120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 361/738] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:07 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:08.450857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:08.450857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:08.457768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:08.459254 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:08.459254 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:08.459618 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:08.460159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:08.460591 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:08.475636 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: DELETE /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 HTTP/1.1 Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:09:08.477341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:08.478760 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13'} Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:08.479520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:08.480712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:08.481953 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:08.481953 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e480a9fc-f7f6-4d54-a7b9-bf75591aa186 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 404 len: 111 microversion: 2.1 time: 0.032993 Aug 18 11:09:08.481953 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 378/739] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:09:08 2022] DELETE /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:08.485479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:08.486159 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:08.487354 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:08.487965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:08.492954 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:08.493440 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:08.493801 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:08.493974 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:08.494279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:08.494638 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:08.494743 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:08.495095 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:08.495385 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:08.495523 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:08.495837 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:08.496261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:08.509792 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 HTTP/1.1 Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:09:08.511340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:08.514261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13'} Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:08.515363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. Aug 18 11:09:08.517056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:08.518378 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance 6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:08.518378 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-d43a391a-60e6-4f7b-a824-1870daceb12a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13" status: 404 len: 111 microversion: 2.1 time: 0.028969 Aug 18 11:09:08.518378 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 379/740] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:08 2022] GET /compute/v2.1/servers/6284fc8b-3ce0-455c-b9f4-ab8ab2a1ab13 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:09:08.640600 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:08.648636 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:08.650185 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:08.651394 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-08ab93e1-92a6-4c9b-9ab6-a3a13f740c6b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1718 microversion: 2.20 time: 0.171986 Aug 18 11:09:08.651955 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 362/741] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:08 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:09:09.666726 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:09.667282 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:09.674498 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:09.674977 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:09.675405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:09.676097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:09.676544 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:09.676963 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:09.691461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: DELETE /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 HTTP/1.1 Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:09:09.692989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:09:09.694559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '1f4d3790-5385-4465-bce8-56ca982c4847'} Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:09.695350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:09:09.696569 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.697792 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:09.697792 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b6778dd3-0a84-4fca-a855-c4d39b2d0795 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 404 len: 111 microversion: 2.1 time: 0.031549 Aug 18 11:09:09.697792 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 380/742] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:09:09 2022] DELETE /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:09.703547 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:09.704160 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f4d3790-5385-4465-bce8-56ca982c4847] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:09.710682 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:09.711168 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:09.711605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:09.712305 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:09.712763 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:09.713193 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:09.727500 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 HTTP/1.1 Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:09:09.729075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:09:09.730783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '1f4d3790-5385-4465-bce8-56ca982c4847'} Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:09.731784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. Aug 18 11:09:09.733783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.735028 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance 1f4d3790-5385-4465-bce8-56ca982c4847 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:09.735028 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c2420c32-f60b-4a3d-a8f4-22d27466d0ae tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847" status: 404 len: 111 microversion: 2.1 time: 0.031414 Aug 18 11:09:09.735028 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 363/743] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:09 2022] GET /compute/v2.1/servers/1f4d3790-5385-4465-bce8-56ca982c4847 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:09.739670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:09.740169 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:09.746129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:09.746613 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:09.747044 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:09.748676 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:09.749307 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:09.749768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:09.765137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: DELETE /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 HTTP/1.1 Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:09:09.766721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:09:09.768211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '1f24c60c-50af-4a18-bd0a-20de259bc3c8'} Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:09.769062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:09:09.770472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.771949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:09.771949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-04ce0be7-0fa5-4763-a297-c651ac3e3fd5 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 404 len: 111 microversion: 2.1 time: 0.032248 Aug 18 11:09:09.771949 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 381/744] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:09:09 2022] DELETE /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:09:09.776437 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:09.777042 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: 1f24c60c-50af-4a18-bd0a-20de259bc3c8] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:09.783088 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:09.783572 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:09.784006 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:09.784707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:09.785139 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:09.785586 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:09.799359 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 HTTP/1.1 Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:09:09.800844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:09:09.802520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '1f24c60c-50af-4a18-bd0a-20de259bc3c8'} Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:09.803380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. Aug 18 11:09:09.804861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:09.806193 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance 1f24c60c-50af-4a18-bd0a-20de259bc3c8 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:09.806193 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-501fe697-b0b0-4302-b92d-2d7ed847ee6a tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8" status: 404 len: 111 microversion: 2.1 time: 0.029569 Aug 18 11:09:09.806193 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 364/745] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:09 2022] GET /compute/v2.1/servers/1f24c60c-50af-4a18-bd0a-20de259bc3c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:10.944965 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:10.945452 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:10.952566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:10.953047 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:10.953481 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:10.954194 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:10.954652 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:10.955071 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:10.968268 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: DELETE /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 HTTP/1.1 Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:09:10.969825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:09:10.971377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': 'f36caff1-93fb-4fd8-8727-9aa6b23ee576'} Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:10.972253 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:09:10.973698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:10.975105 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:10.975105 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f45ad18d-43b8-4a2d-9c94-9780952500de tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 404 len: 111 microversion: 2.1 time: 0.030202 Aug 18 11:09:10.975105 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 382/746] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:09:10 2022] DELETE /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:10.980366 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:10.980974 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] [instance: f36caff1-93fb-4fd8-8727-9aa6b23ee576] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:10.987709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:10.988200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:10.988638 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:10.989336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:10.989834 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:10.990264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:11.004334 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] HTTP exception thrown: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Request method failure captured: Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 HTTP/1.1 Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxhhvesfPHDx51VjAeLRIhNMjKAc1DGxZmGn_elWshaXFH3YSwes4f2_-Fr9dKxmtE7Zc23Bhf0yZQCI86JPtnF_hWrlp4yX6wRvitMXh9irTrrU-xY3XHOJJE9jecadSpBexl7m9qR9SBZYFXKtzFxdn96R3QPKyrG1rQslerw8c8 Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:09:11.005870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_397eac573c2d473e881b07c87255700c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/397eac573c2d473e881b07c87255700c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/397eac573c2d473e881b07c87255700c"}]}] Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 397eac573c2d473e881b07c87255700c Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1124302917 Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 57e117589fc14e4d9d8d8494bddf9c12 Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeNegativeTest-1124302917-project Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:09:11.007378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'f36caff1-93fb-4fd8-8727-9aa6b23ee576'} Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:11.008172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. Aug 18 11:09:11.009330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:11.010556 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] Returning 404 to user: Instance f36caff1-93fb-4fd8-8727-9aa6b23ee576 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:11.010556 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a0253f3a-5fac-407a-a7cc-4de99d3f4767 tempest-AttachVolumeNegativeTest-1124302917 tempest-AttachVolumeNegativeTest-1124302917-project] 10.222.0.15 "GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576" status: 404 len: 111 microversion: 2.1 time: 0.030756 Aug 18 11:09:11.010556 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 365/747] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:10 2022] GET /compute/v2.1/servers/f36caff1-93fb-4fd8-8727-9aa6b23ee576 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:12.398860 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0d4b6c5e-8e98-4cd1-b296-2adb6ba0b832 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:12.399337 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0d4b6c5e-8e98-4cd1-b296-2adb6ba0b832 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:12.406711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d4b6c5e-8e98-4cd1-b296-2adb6ba0b832 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:12.407314 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d4b6c5e-8e98-4cd1-b296-2adb6ba0b832 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:12.407756 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d4b6c5e-8e98-4cd1-b296-2adb6ba0b832 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:12.408458 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d4b6c5e-8e98-4cd1-b296-2adb6ba0b832 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:12.408923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d4b6c5e-8e98-4cd1-b296-2adb6ba0b832 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:12.409424 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0d4b6c5e-8e98-4cd1-b296-2adb6ba0b832 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:12.433918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0d4b6c5e-8e98-4cd1-b296-2adb6ba0b832 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/ips" status: 200 len: 146 microversion: 2.1 time: 0.038877 Aug 18 11:09:12.434491 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 383/748] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Aug 18 11:09:12 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:14.799420 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6e609b91-f540-4c88-978d-cd9db3012402 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f9d99dc-6a21-4e1b-87dc-e249ea8036de"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:09:14.802004 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6e609b91-f540-4c88-978d-cd9db3012402 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:14.808788 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e609b91-f540-4c88-978d-cd9db3012402 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:14.809276 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e609b91-f540-4c88-978d-cd9db3012402 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:14.809742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e609b91-f540-4c88-978d-cd9db3012402 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:14.810747 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e609b91-f540-4c88-978d-cd9db3012402 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:14.811398 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e609b91-f540-4c88-978d-cd9db3012402 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:14.811833 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6e609b91-f540-4c88-978d-cd9db3012402 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:15.071484 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6e609b91-f540-4c88-978d-cd9db3012402 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278582 Aug 18 11:09:15.072559 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 366/749] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:09:14 2022] POST /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:09:16.974938 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ecd900cd-e2ac-4dee-a9eb-ba00e3597e1a tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec8a1da60>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:17.022450 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ecd900cd-e2ac-4dee-a9eb-ba00e3597e1a tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/f64cb0ac-a6c9-4934-961a-de4189e6883f" status: 200 len: 350 microversion: 2.1 time: 0.051283 Aug 18 11:09:17.023020 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 384/750] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:09:16 2022] GET /compute/v2.1/os-volumes/f64cb0ac-a6c9-4934-961a-de4189e6883f => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:18.366533 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c86955f1-9f75-4725-a6f4-51a740295466 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec8a0af70>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:18.415413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c86955f1-9f75-4725-a6f4-51a740295466 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9d628ff0-2e95-42c5-abc6-51a4de68066a" status: 200 len: 350 microversion: 2.1 time: 0.053061 Aug 18 11:09:18.416088 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 367/751] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:09:18 2022] GET /compute/v2.1/os-volumes/9d628ff0-2e95-42c5-abc6-51a4de68066a => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:19.769407 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ccab1bc8-892b-4193-a961-2708b0bbb42d tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec8a0ddc0>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:19.814977 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ccab1bc8-892b-4193-a961-2708b0bbb42d tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/41862789-bf5c-43cf-aebc-cf616012acfa" status: 200 len: 351 microversion: 2.1 time: 0.049776 Aug 18 11:09:19.815682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 385/752] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Aug 18 11:09:19 2022] GET /compute/v2.1/os-volumes/41862789-bf5c-43cf-aebc-cf616012acfa => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:19.829829 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d0a89a03-a8dc-47e7-a345-d360e3eb938f tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec89b6790>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:19.912812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d0a89a03-a8dc-47e7-a345-d360e3eb938f tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088142 Aug 18 11:09:19.913380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 368/753] 10.222.0.15 () {58 vars in 1134 bytes} [Thu Aug 18 11:09:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:19.927041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e2227e83-b6de-473b-8adf-8dc812f754c6 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec8a95d30>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:20.010719 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e2227e83-b6de-473b-8adf-8dc812f754c6 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087318 Aug 18 11:09:20.011281 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 386/754] 10.222.0.15 () {58 vars in 1149 bytes} [Thu Aug 18 11:09:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:20.025406 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4cb0e450-cabb-4766-b3bf-ae02c0d2e267 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec89eb280>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:20.111126 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4cb0e450-cabb-4766-b3bf-ae02c0d2e267 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089382 Aug 18 11:09:20.112049 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 369/755] 10.222.0.15 () {58 vars in 1134 bytes} [Thu Aug 18 11:09:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:20.125799 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2f3578b4-2a04-4f36-870d-646c79204310 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec89f09d0>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:20.207455 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2f3578b4-2a04-4f36-870d-646c79204310 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086673 Aug 18 11:09:20.208103 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 387/756] 10.222.0.15 () {58 vars in 1167 bytes} [Thu Aug 18 11:09:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:20.220848 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3070b64e-d995-424f-b3db-e5bc9bcd8a22 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec89ad700>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:20.304159 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3070b64e-d995-424f-b3db-e5bc9bcd8a22 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086993 Aug 18 11:09:20.304741 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 370/757] 10.222.0.15 () {58 vars in 1170 bytes} [Thu Aug 18 11:09:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:20.319745 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b252b99e-1cd9-48f2-8ead-467878230501 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec8a1d0d0>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:20.405930 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b252b99e-1cd9-48f2-8ead-467878230501 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089942 Aug 18 11:09:20.406769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 388/758] 10.222.0.15 () {58 vars in 1155 bytes} [Thu Aug 18 11:09:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:20.420869 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f3bbf827-3810-4e6d-9fcb-eeebe0038535 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec8ac3b80>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:20.657352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f3bbf827-3810-4e6d-9fcb-eeebe0038535 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.241753 Aug 18 11:09:20.657963 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 371/759] 10.222.0.15 () {58 vars in 1188 bytes} [Thu Aug 18 11:09:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:20.671213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7e5b48bb-3cb8-4bdb-b40b-6da5c9501c29 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] Calling method '.version_select at 0x7f7ec8bc8dc0>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:20.754892 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7e5b48bb-3cb8-4bdb-b40b-6da5c9501c29 tempest-VolumesTestJSON-505365686 tempest-VolumesTestJSON-505365686-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088104 Aug 18 11:09:20.755464 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 389/760] 10.222.0.15 () {58 vars in 1155 bytes} [Thu Aug 18 11:09:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:21.573495 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-626419c6-93fa-4ecc-91ce-075a65e63037 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:09:21.575603 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:21.581703 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-626419c6-93fa-4ecc-91ce-075a65e63037 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:21.582201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-626419c6-93fa-4ecc-91ce-075a65e63037 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:21.583276 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-626419c6-93fa-4ecc-91ce-075a65e63037 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:21.645221 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-626419c6-93fa-4ecc-91ce-075a65e63037 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Going to try to stop instance {{(pid=120801) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:09:21.686923 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-626419c6-93fa-4ecc-91ce-075a65e63037 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/action" status: 202 len: 0 microversion: 2.1 time: 0.117108 Aug 18 11:09:21.687591 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 372/761] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:09:21 2022] POST /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:09:21.696311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3380e5fa-1d9d-40f4-9ec0-2546be232ef1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:21.696923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3380e5fa-1d9d-40f4-9ec0-2546be232ef1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:21.699198 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:21.706065 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3380e5fa-1d9d-40f4-9ec0-2546be232ef1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:21.706566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3380e5fa-1d9d-40f4-9ec0-2546be232ef1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:21.707041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3380e5fa-1d9d-40f4-9ec0-2546be232ef1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:21.707799 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3380e5fa-1d9d-40f4-9ec0-2546be232ef1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:21.708400 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3380e5fa-1d9d-40f4-9ec0-2546be232ef1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:21.708831 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3380e5fa-1d9d-40f4-9ec0-2546be232ef1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:21.846109 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3380e5fa-1d9d-40f4-9ec0-2546be232ef1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:21.854925 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3380e5fa-1d9d-40f4-9ec0-2546be232ef1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.162937 Aug 18 11:09:21.855485 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 390/762] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:21 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:22.877481 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ab5e22d5-17d4-4791-a25c-2b96b9d5fd97 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:22.878229 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ab5e22d5-17d4-4791-a25c-2b96b9d5fd97 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:22.884384 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab5e22d5-17d4-4791-a25c-2b96b9d5fd97 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:22.884868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab5e22d5-17d4-4791-a25c-2b96b9d5fd97 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:22.885299 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab5e22d5-17d4-4791-a25c-2b96b9d5fd97 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:22.886042 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab5e22d5-17d4-4791-a25c-2b96b9d5fd97 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:22.886490 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab5e22d5-17d4-4791-a25c-2b96b9d5fd97 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:22.887039 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ab5e22d5-17d4-4791-a25c-2b96b9d5fd97 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:23.019845 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ab5e22d5-17d4-4791-a25c-2b96b9d5fd97 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:23.027749 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ab5e22d5-17d4-4791-a25c-2b96b9d5fd97 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.155196 Aug 18 11:09:23.028313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 373/763] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:22 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:24.051049 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-67216aa6-704e-4b6c-9be4-c046fa9bd9f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:24.051642 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-67216aa6-704e-4b6c-9be4-c046fa9bd9f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:24.058102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67216aa6-704e-4b6c-9be4-c046fa9bd9f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:24.058579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67216aa6-704e-4b6c-9be4-c046fa9bd9f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:24.059009 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67216aa6-704e-4b6c-9be4-c046fa9bd9f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:24.059690 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67216aa6-704e-4b6c-9be4-c046fa9bd9f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:24.060801 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67216aa6-704e-4b6c-9be4-c046fa9bd9f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:24.061268 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-67216aa6-704e-4b6c-9be4-c046fa9bd9f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:24.191084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-67216aa6-704e-4b6c-9be4-c046fa9bd9f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:24.199030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-67216aa6-704e-4b6c-9be4-c046fa9bd9f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.151775 Aug 18 11:09:24.199595 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 391/764] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:24 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:25.222361 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5c49fd78-eb12-4703-b7e1-9a5cf8ef3364 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:25.223010 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5c49fd78-eb12-4703-b7e1-9a5cf8ef3364 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:25.229664 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c49fd78-eb12-4703-b7e1-9a5cf8ef3364 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:25.230148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c49fd78-eb12-4703-b7e1-9a5cf8ef3364 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:25.230584 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c49fd78-eb12-4703-b7e1-9a5cf8ef3364 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:25.231351 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c49fd78-eb12-4703-b7e1-9a5cf8ef3364 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:25.231772 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c49fd78-eb12-4703-b7e1-9a5cf8ef3364 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:25.232493 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5c49fd78-eb12-4703-b7e1-9a5cf8ef3364 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:25.379544 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5c49fd78-eb12-4703-b7e1-9a5cf8ef3364 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:25.387255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5c49fd78-eb12-4703-b7e1-9a5cf8ef3364 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.170762 Aug 18 11:09:25.388261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 374/765] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:25 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:26.411274 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-99fdd449-f2f5-4e8e-8184-2ee37262039c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:26.411898 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-99fdd449-f2f5-4e8e-8184-2ee37262039c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:26.418688 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99fdd449-f2f5-4e8e-8184-2ee37262039c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:26.419182 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99fdd449-f2f5-4e8e-8184-2ee37262039c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:26.420638 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99fdd449-f2f5-4e8e-8184-2ee37262039c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:26.421365 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99fdd449-f2f5-4e8e-8184-2ee37262039c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:26.421858 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99fdd449-f2f5-4e8e-8184-2ee37262039c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:26.422287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-99fdd449-f2f5-4e8e-8184-2ee37262039c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:26.567062 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-99fdd449-f2f5-4e8e-8184-2ee37262039c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:26.575021 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-99fdd449-f2f5-4e8e-8184-2ee37262039c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.168149 Aug 18 11:09:26.575695 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 392/766] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:26 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:27.597485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-212d01ed-f4e9-4871-bdde-24d12596dfd4 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:27.598133 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-212d01ed-f4e9-4871-bdde-24d12596dfd4 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:27.604517 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-212d01ed-f4e9-4871-bdde-24d12596dfd4 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:27.605008 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-212d01ed-f4e9-4871-bdde-24d12596dfd4 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:27.605445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-212d01ed-f4e9-4871-bdde-24d12596dfd4 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:27.607313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-212d01ed-f4e9-4871-bdde-24d12596dfd4 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:27.607825 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-212d01ed-f4e9-4871-bdde-24d12596dfd4 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:27.608560 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-212d01ed-f4e9-4871-bdde-24d12596dfd4 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:27.749352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-212d01ed-f4e9-4871-bdde-24d12596dfd4 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:27.757696 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-212d01ed-f4e9-4871-bdde-24d12596dfd4 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.163940 Aug 18 11:09:27.758264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 375/767] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:27 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:28.780467 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-dba18b92-eedb-4342-8c1e-1998549eedf3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:28.781107 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-dba18b92-eedb-4342-8c1e-1998549eedf3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:28.787258 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dba18b92-eedb-4342-8c1e-1998549eedf3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:28.787735 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dba18b92-eedb-4342-8c1e-1998549eedf3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:28.788167 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dba18b92-eedb-4342-8c1e-1998549eedf3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:28.788853 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dba18b92-eedb-4342-8c1e-1998549eedf3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:28.789305 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dba18b92-eedb-4342-8c1e-1998549eedf3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:28.789755 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-dba18b92-eedb-4342-8c1e-1998549eedf3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:28.939283 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-dba18b92-eedb-4342-8c1e-1998549eedf3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:28.947478 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-dba18b92-eedb-4342-8c1e-1998549eedf3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.170958 Aug 18 11:09:28.948116 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 393/768] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:28 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:29.970220 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f4fa7205-86a4-4b8d-be92-ec1bb96491df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:29.970835 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f4fa7205-86a4-4b8d-be92-ec1bb96491df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:29.977151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4fa7205-86a4-4b8d-be92-ec1bb96491df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:29.977665 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4fa7205-86a4-4b8d-be92-ec1bb96491df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:29.978101 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4fa7205-86a4-4b8d-be92-ec1bb96491df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:29.978787 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4fa7205-86a4-4b8d-be92-ec1bb96491df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:29.979237 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4fa7205-86a4-4b8d-be92-ec1bb96491df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:29.979658 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f4fa7205-86a4-4b8d-be92-ec1bb96491df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:30.111558 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f4fa7205-86a4-4b8d-be92-ec1bb96491df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:30.119900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f4fa7205-86a4-4b8d-be92-ec1bb96491df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.154251 Aug 18 11:09:30.120466 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 376/769] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:29 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:31.141596 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fcd7fc18-9ad5-4926-b4a7-24b598802a03 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:31.142250 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fcd7fc18-9ad5-4926-b4a7-24b598802a03 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:31.148853 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fcd7fc18-9ad5-4926-b4a7-24b598802a03 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:31.149333 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fcd7fc18-9ad5-4926-b4a7-24b598802a03 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:31.149798 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fcd7fc18-9ad5-4926-b4a7-24b598802a03 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:31.150483 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fcd7fc18-9ad5-4926-b4a7-24b598802a03 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:31.150931 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fcd7fc18-9ad5-4926-b4a7-24b598802a03 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:31.151347 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fcd7fc18-9ad5-4926-b4a7-24b598802a03 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:31.285602 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-fcd7fc18-9ad5-4926-b4a7-24b598802a03 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:31.294076 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fcd7fc18-9ad5-4926-b4a7-24b598802a03 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.156901 Aug 18 11:09:31.295206 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 394/770] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:31 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:32.316136 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1e74e073-09c2-4cc5-994d-0fb1b431ca0d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:32.316932 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1e74e073-09c2-4cc5-994d-0fb1b431ca0d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:32.327679 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e74e073-09c2-4cc5-994d-0fb1b431ca0d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:32.327679 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e74e073-09c2-4cc5-994d-0fb1b431ca0d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:32.327679 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e74e073-09c2-4cc5-994d-0fb1b431ca0d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:32.327679 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e74e073-09c2-4cc5-994d-0fb1b431ca0d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:32.328057 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e74e073-09c2-4cc5-994d-0fb1b431ca0d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:32.328057 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1e74e073-09c2-4cc5-994d-0fb1b431ca0d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:32.470426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1e74e073-09c2-4cc5-994d-0fb1b431ca0d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:32.479875 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1e74e073-09c2-4cc5-994d-0fb1b431ca0d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.167576 Aug 18 11:09:32.480435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 377/771] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:32 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:33.501987 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-43266265-3736-4ec2-bf6f-7245a32882e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:33.502598 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-43266265-3736-4ec2-bf6f-7245a32882e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:33.509557 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-43266265-3736-4ec2-bf6f-7245a32882e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:33.510074 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-43266265-3736-4ec2-bf6f-7245a32882e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:33.510505 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-43266265-3736-4ec2-bf6f-7245a32882e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:33.511228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-43266265-3736-4ec2-bf6f-7245a32882e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:33.511683 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-43266265-3736-4ec2-bf6f-7245a32882e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:33.512105 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-43266265-3736-4ec2-bf6f-7245a32882e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:33.644601 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-43266265-3736-4ec2-bf6f-7245a32882e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:33.652657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-43266265-3736-4ec2-bf6f-7245a32882e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.154642 Aug 18 11:09:33.653213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 395/772] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:33 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:34.674189 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-918a9d72-f54d-469c-8754-272c16156d1f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:34.674730 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-918a9d72-f54d-469c-8754-272c16156d1f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:34.681157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-918a9d72-f54d-469c-8754-272c16156d1f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:34.681685 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-918a9d72-f54d-469c-8754-272c16156d1f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:34.682123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-918a9d72-f54d-469c-8754-272c16156d1f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:34.682809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-918a9d72-f54d-469c-8754-272c16156d1f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:34.683261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-918a9d72-f54d-469c-8754-272c16156d1f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:34.683688 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-918a9d72-f54d-469c-8754-272c16156d1f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:34.823693 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-918a9d72-f54d-469c-8754-272c16156d1f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:34.831615 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-918a9d72-f54d-469c-8754-272c16156d1f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.161912 Aug 18 11:09:34.832177 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 378/773] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:34 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:35.854040 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3079dbf0-79bf-4b07-a659-b88ecd0af98d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:35.854658 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3079dbf0-79bf-4b07-a659-b88ecd0af98d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:35.861670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3079dbf0-79bf-4b07-a659-b88ecd0af98d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:35.862165 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3079dbf0-79bf-4b07-a659-b88ecd0af98d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:35.862842 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3079dbf0-79bf-4b07-a659-b88ecd0af98d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:35.863711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3079dbf0-79bf-4b07-a659-b88ecd0af98d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:35.864380 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3079dbf0-79bf-4b07-a659-b88ecd0af98d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:35.864807 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3079dbf0-79bf-4b07-a659-b88ecd0af98d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:35.869674 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=63 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:36.015638 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3079dbf0-79bf-4b07-a659-b88ecd0af98d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:36.023972 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3079dbf0-79bf-4b07-a659-b88ecd0af98d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.173771 Aug 18 11:09:36.024554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 396/774] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:35 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:37.047150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-29390caa-31fa-4a24-99a2-3a992e8089df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:37.047916 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-29390caa-31fa-4a24-99a2-3a992e8089df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:37.055062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29390caa-31fa-4a24-99a2-3a992e8089df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:37.055553 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29390caa-31fa-4a24-99a2-3a992e8089df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:37.056017 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29390caa-31fa-4a24-99a2-3a992e8089df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:37.056713 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29390caa-31fa-4a24-99a2-3a992e8089df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:37.057323 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29390caa-31fa-4a24-99a2-3a992e8089df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:37.057865 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29390caa-31fa-4a24-99a2-3a992e8089df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:37.060830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:37.206926 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-29390caa-31fa-4a24-99a2-3a992e8089df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:37.215840 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-29390caa-31fa-4a24-99a2-3a992e8089df tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.173084 Aug 18 11:09:37.217394 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 379/775] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:37 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:38.240071 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b0fbf90e-de7b-4624-9f8a-97fc07e70ad6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:38.240683 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b0fbf90e-de7b-4624-9f8a-97fc07e70ad6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:38.247213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0fbf90e-de7b-4624-9f8a-97fc07e70ad6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:38.247830 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0fbf90e-de7b-4624-9f8a-97fc07e70ad6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:38.248291 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0fbf90e-de7b-4624-9f8a-97fc07e70ad6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:38.248967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0fbf90e-de7b-4624-9f8a-97fc07e70ad6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:38.249420 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0fbf90e-de7b-4624-9f8a-97fc07e70ad6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:38.249867 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b0fbf90e-de7b-4624-9f8a-97fc07e70ad6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:38.395967 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b0fbf90e-de7b-4624-9f8a-97fc07e70ad6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:38.405305 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b0fbf90e-de7b-4624-9f8a-97fc07e70ad6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.168951 Aug 18 11:09:38.405995 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 397/776] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:38 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:39.428354 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-39aaf70e-0ee8-4e86-82ef-56dc90da0e8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:39.428913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-39aaf70e-0ee8-4e86-82ef-56dc90da0e8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:39.435687 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39aaf70e-0ee8-4e86-82ef-56dc90da0e8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:39.436164 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39aaf70e-0ee8-4e86-82ef-56dc90da0e8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:39.436594 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39aaf70e-0ee8-4e86-82ef-56dc90da0e8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:39.437277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39aaf70e-0ee8-4e86-82ef-56dc90da0e8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:39.437749 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39aaf70e-0ee8-4e86-82ef-56dc90da0e8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:39.438166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39aaf70e-0ee8-4e86-82ef-56dc90da0e8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:39.566715 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-39aaf70e-0ee8-4e86-82ef-56dc90da0e8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:39.574767 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-39aaf70e-0ee8-4e86-82ef-56dc90da0e8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.151575 Aug 18 11:09:39.575893 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 380/777] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:39 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:40.596283 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-400177cf-3808-459d-a82c-52a0334f80f2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:40.596923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-400177cf-3808-459d-a82c-52a0334f80f2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:40.603634 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-400177cf-3808-459d-a82c-52a0334f80f2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:40.604124 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-400177cf-3808-459d-a82c-52a0334f80f2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:40.604560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-400177cf-3808-459d-a82c-52a0334f80f2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:40.605252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-400177cf-3808-459d-a82c-52a0334f80f2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:40.605746 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-400177cf-3808-459d-a82c-52a0334f80f2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:40.606173 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-400177cf-3808-459d-a82c-52a0334f80f2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:40.740017 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-400177cf-3808-459d-a82c-52a0334f80f2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:40.748434 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-400177cf-3808-459d-a82c-52a0334f80f2 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.155806 Aug 18 11:09:40.749010 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 398/778] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:40 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:41.769337 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d19006c5-61ea-4a6b-9f9b-dcc5c9349e34 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:41.769957 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d19006c5-61ea-4a6b-9f9b-dcc5c9349e34 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:41.776211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d19006c5-61ea-4a6b-9f9b-dcc5c9349e34 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:41.776689 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d19006c5-61ea-4a6b-9f9b-dcc5c9349e34 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:41.777122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d19006c5-61ea-4a6b-9f9b-dcc5c9349e34 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:41.777819 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d19006c5-61ea-4a6b-9f9b-dcc5c9349e34 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:41.778268 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d19006c5-61ea-4a6b-9f9b-dcc5c9349e34 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:41.779206 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d19006c5-61ea-4a6b-9f9b-dcc5c9349e34 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:41.911986 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d19006c5-61ea-4a6b-9f9b-dcc5c9349e34 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:41.920489 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d19006c5-61ea-4a6b-9f9b-dcc5c9349e34 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1725 microversion: 2.1 time: 0.154794 Aug 18 11:09:41.920983 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 381/779] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:41 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:42.380604 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c5cc87b6-cc92-4d91-a391-739a346a0e6e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:42.382936 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c5cc87b6-cc92-4d91-a391-739a346a0e6e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:42.390419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c5cc87b6-cc92-4d91-a391-739a346a0e6e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:42.390906 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c5cc87b6-cc92-4d91-a391-739a346a0e6e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:42.391345 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c5cc87b6-cc92-4d91-a391-739a346a0e6e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:42.392043 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c5cc87b6-cc92-4d91-a391-739a346a0e6e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:42.392499 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c5cc87b6-cc92-4d91-a391-739a346a0e6e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:42.392926 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c5cc87b6-cc92-4d91-a391-739a346a0e6e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:42.424573 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c5cc87b6-cc92-4d91-a391-739a346a0e6e tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047873 Aug 18 11:09:42.425133 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 399/780] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Aug 18 11:09:42 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:42.486558 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f080b47d-fe2a-4956-b2c5-d03b57105463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:42.487054 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f080b47d-fe2a-4956-b2c5-d03b57105463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:42.493101 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f080b47d-fe2a-4956-b2c5-d03b57105463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:42.493627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f080b47d-fe2a-4956-b2c5-d03b57105463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:42.494071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f080b47d-fe2a-4956-b2c5-d03b57105463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:42.494761 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f080b47d-fe2a-4956-b2c5-d03b57105463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:42.495218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f080b47d-fe2a-4956-b2c5-d03b57105463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:42.495646 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f080b47d-fe2a-4956-b2c5-d03b57105463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:42.523462 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f080b47d-fe2a-4956-b2c5-d03b57105463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:09:42.598277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f080b47d-fe2a-4956-b2c5-d03b57105463 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 204 len: 0 microversion: 2.20 time: 0.115467 Aug 18 11:09:42.598947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 382/781] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Aug 18 11:09:42 2022] DELETE /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:09:42.607966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:42.608561 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:42.615634 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:42.616113 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:42.616543 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:42.617230 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:42.617744 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:42.618170 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:42.758031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:42.766236 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:42.767748 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:42.768903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-46d0e8b0-8bc3-4454-b4fc-1f0481463828 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.165464 Aug 18 11:09:42.769455 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 400/782] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:42 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:42.942792 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c3698cdc-5b9d-4bbe-a7b9-0d694e627001 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:42.943488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c3698cdc-5b9d-4bbe-a7b9-0d694e627001 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:42.949973 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3698cdc-5b9d-4bbe-a7b9-0d694e627001 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:42.950711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3698cdc-5b9d-4bbe-a7b9-0d694e627001 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:42.951289 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3698cdc-5b9d-4bbe-a7b9-0d694e627001 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:42.951868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3698cdc-5b9d-4bbe-a7b9-0d694e627001 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:42.952329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3698cdc-5b9d-4bbe-a7b9-0d694e627001 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:42.952756 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3698cdc-5b9d-4bbe-a7b9-0d694e627001 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:43.096565 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c3698cdc-5b9d-4bbe-a7b9-0d694e627001 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:43.105077 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c3698cdc-5b9d-4bbe-a7b9-0d694e627001 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1702 microversion: 2.1 time: 0.166480 Aug 18 11:09:43.105677 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 383/783] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:42 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1702 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:43.130868 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7f9f1d9e-6c25-4f84-b73f-672e242d07bf tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:09:43.137440 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7f9f1d9e-6c25-4f84-b73f-672e242d07bf tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:43.139353 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7f9f1d9e-6c25-4f84-b73f-672e242d07bf tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:43.139641 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7f9f1d9e-6c25-4f84-b73f-672e242d07bf tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:43.205391 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7f9f1d9e-6c25-4f84-b73f-672e242d07bf tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Going to try to start instance {{(pid=120800) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 11:09:43.254080 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7f9f1d9e-6c25-4f84-b73f-672e242d07bf tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/action" status: 202 len: 0 microversion: 2.1 time: 0.126591 Aug 18 11:09:43.257793 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 401/784] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:09:43 2022] POST /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:09:43.262876 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-cb019543-5218-4f17-a192-761eaedafbec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:43.263521 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-cb019543-5218-4f17-a192-761eaedafbec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:43.269845 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb019543-5218-4f17-a192-761eaedafbec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:43.270773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb019543-5218-4f17-a192-761eaedafbec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:43.271315 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb019543-5218-4f17-a192-761eaedafbec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:43.272287 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb019543-5218-4f17-a192-761eaedafbec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:43.272593 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb019543-5218-4f17-a192-761eaedafbec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:43.273020 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cb019543-5218-4f17-a192-761eaedafbec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:43.421284 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-cb019543-5218-4f17-a192-761eaedafbec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:43.433123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-cb019543-5218-4f17-a192-761eaedafbec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1711 microversion: 2.1 time: 0.173988 Aug 18 11:09:43.433854 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 384/785] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:43 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1711 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:43.793497 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:43.794373 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:43.800945 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:43.801432 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:43.801945 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:43.802699 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:43.803157 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:43.803598 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:43.944140 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:43.953811 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:43.955290 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:43.956456 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-75ac0f68-bc8e-458a-aaac-acdbfb0690e3 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.168038 Aug 18 11:09:43.957273 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 402/786] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:43 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:44.455548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-eefc3c8e-d149-48dc-a82c-0f2ed8863eda tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:44.456088 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-eefc3c8e-d149-48dc-a82c-0f2ed8863eda tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:44.462996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eefc3c8e-d149-48dc-a82c-0f2ed8863eda tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:44.463485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eefc3c8e-d149-48dc-a82c-0f2ed8863eda tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:44.463917 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eefc3c8e-d149-48dc-a82c-0f2ed8863eda tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:44.464621 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eefc3c8e-d149-48dc-a82c-0f2ed8863eda tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:44.465081 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eefc3c8e-d149-48dc-a82c-0f2ed8863eda tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:44.465505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-eefc3c8e-d149-48dc-a82c-0f2ed8863eda tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:44.893562 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-eefc3c8e-d149-48dc-a82c-0f2ed8863eda tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:44.904509 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-eefc3c8e-d149-48dc-a82c-0f2ed8863eda tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1711 microversion: 2.1 time: 0.452275 Aug 18 11:09:44.905094 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 385/787] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:44 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1711 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:44.979577 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:44.980297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:44.987966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:44.988468 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:44.989051 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:44.989811 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:44.990276 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:44.990704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:45.146355 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:45.156814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:45.158806 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:45.160325 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-293fccec-5bf3-4824-b40a-bfc3acca754c tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1724 microversion: 2.20 time: 0.184914 Aug 18 11:09:45.161589 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 403/788] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:44 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:45.603096 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-a95972fe-88f5-4360-893f-e3bb23df8e6a req-f433e889-10e4-4a04-9d0a-24c8d192d6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5aa4f6f-cb29-46ab-b558-e91195e757fc", "name": "network-vif-deleted", "tag": "b6d81a7c-88f7-44ae-a304-da843f87fdd7"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:09:45.619638 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-a95972fe-88f5-4360-893f-e3bb23df8e6a req-f433e889-10e4-4a04-9d0a-24c8d192d6f7 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:45.620520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-a95972fe-88f5-4360-893f-e3bb23df8e6a req-f433e889-10e4-4a04-9d0a-24c8d192d6f7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:45.621153 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-a95972fe-88f5-4360-893f-e3bb23df8e6a req-f433e889-10e4-4a04-9d0a-24c8d192d6f7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:45.637461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-a95972fe-88f5-4360-893f-e3bb23df8e6a req-f433e889-10e4-4a04-9d0a-24c8d192d6f7 service nova] Creating event network-vif-deleted:b6d81a7c-88f7-44ae-a304-da843f87fdd7 for instance a5aa4f6f-cb29-46ab-b558-e91195e757fc on hv-cinder-82660 Aug 18 11:09:45.644045 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-a95972fe-88f5-4360-893f-e3bb23df8e6a req-f433e889-10e4-4a04-9d0a-24c8d192d6f7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046092 Aug 18 11:09:45.645104 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 386/789] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:09:45.930018 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-61558667-723e-4761-b1db-7b3a4e48000b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:45.930984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-61558667-723e-4761-b1db-7b3a4e48000b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:45.937884 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61558667-723e-4761-b1db-7b3a4e48000b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:45.938465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61558667-723e-4761-b1db-7b3a4e48000b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:45.938978 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61558667-723e-4761-b1db-7b3a4e48000b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:45.940097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61558667-723e-4761-b1db-7b3a4e48000b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:45.940775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61558667-723e-4761-b1db-7b3a4e48000b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:45.941424 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-61558667-723e-4761-b1db-7b3a4e48000b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:46.102124 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-61558667-723e-4761-b1db-7b3a4e48000b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:46.115141 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-61558667-723e-4761-b1db-7b3a4e48000b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1711 microversion: 2.1 time: 0.187265 Aug 18 11:09:46.115141 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 404/790] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:45 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1711 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:46.186156 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:46.187046 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:46.193899 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:46.194393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:46.194848 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:46.195564 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:46.197290 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:46.197805 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:46.238345 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:46.238941 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:46.239386 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:46.239848 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lazy-loading 'fault' on Instance uuid a5aa4f6f-cb29-46ab-b558-e91195e757fc {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:09:46.283908 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:46.292726 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:46.294553 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7dc5501d59fb4593b405f0e9bd2e49ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c723b1181c94699b389f0fc03e19af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:46.295984 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c971d7e3-2546-4d84-b6f0-e49a4c42b548 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 200 len: 1371 microversion: 2.20 time: 0.115276 Aug 18 11:09:46.296888 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 387/791] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:46 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:09:47.134579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fab4bdb5-5350-47c1-835b-12903454b305 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:47.135196 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fab4bdb5-5350-47c1-835b-12903454b305 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:47.141775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fab4bdb5-5350-47c1-835b-12903454b305 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:47.142274 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fab4bdb5-5350-47c1-835b-12903454b305 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:47.142712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fab4bdb5-5350-47c1-835b-12903454b305 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:47.143419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fab4bdb5-5350-47c1-835b-12903454b305 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:47.143870 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fab4bdb5-5350-47c1-835b-12903454b305 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:47.144294 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fab4bdb5-5350-47c1-835b-12903454b305 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:47.296369 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-fab4bdb5-5350-47c1-835b-12903454b305 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:09:47.305819 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fab4bdb5-5350-47c1-835b-12903454b305 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1715 microversion: 2.1 time: 0.175064 Aug 18 11:09:47.306498 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 405/792] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:09:47 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1715 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:09:47.328178 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:47.328716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:47.334944 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:47.335430 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:47.335871 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:47.336603 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:47.337062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:47.337488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:47.351554 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] HTTP exception thrown: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Request method failure captured: Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc HTTP/1.1 Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxdIayRbamyRfEfP6BbM36tvM44lJ8H11GyaA5HvxPwGgrQHsdE9Px98wZ94MoCNuKRtDk_v20CDunzRUKyv6uGYk71E563PMPl77DVjcEO1aj0uPChKHogPwamHFQybAd_urF2URK5o72HxpCfWjiZw5_kzEDLzeMYb61P0-Sn0OM Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:09:47.353218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c723b1181c94699b389f0fc03e19af6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c723b1181c94699b389f0fc03e19af6"}]}] Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 7dc5501d59fb4593b405f0e9bd2e49ef Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:47.354757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'a5aa4f6f-cb29-46ab-b558-e91195e757fc'} Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:47.355532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:47.357496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:47.358810 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Returning 404 to user: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:47.358810 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1360397a-7c64-4279-a56f-248474ccd294 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 404 len: 111 microversion: 2.20 time: 0.031912 Aug 18 11:09:47.358810 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 388/793] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:47 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:09:47.367772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-43caa35f-77a0-4987-82e6-2e76ab713e4b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '.version_select at 0x7f7ec8a141f0>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:47.388168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-43caa35f-77a0-4987-82e6-2e76ab713e4b tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-806743886" status: 204 len: 0 microversion: 2.20 time: 0.023671 Aug 18 11:09:47.388771 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 406/794] 10.222.0.15 () {60 vars in 1259 bytes} [Thu Aug 18 11:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-806743886 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 11:09:49.183393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:49.183931 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:49.191422 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:49.191906 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:49.192343 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:49.193045 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:49.193498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:49.193949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:49.210059 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] HTTP exception thrown: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Request method failure captured: Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: DELETE /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc HTTP/1.1 Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxdIayRbamyRfEfP6BbM36tvM44lJ8H11GyaA5HvxPwGgrQHsdE9Px98wZ94MoCNuKRtDk_v20CDunzRUKyv6uGYk71E563PMPl77DVjcEO1aj0uPChKHogPwamHFQybAd_urF2URK5o72HxpCfWjiZw5_kzEDLzeMYb61P0-Sn0OM Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:09:49.211150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c723b1181c94699b389f0fc03e19af6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c723b1181c94699b389f0fc03e19af6"}]}] Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 7dc5501d59fb4593b405f0e9bd2e49ef Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:49.213142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'a5aa4f6f-cb29-46ab-b558-e91195e757fc'} Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:49.214943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:49.216291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:49.218330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Returning 404 to user: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:49.218330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7be9bc87-86ca-4a90-a0c8-673aea7f5e79 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 404 len: 111 microversion: 2.20 time: 0.033100 Aug 18 11:09:49.218330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 389/795] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Aug 18 11:09:49 2022] DELETE /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:09:49.222618 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:49.223408 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: a5aa4f6f-cb29-46ab-b558-e91195e757fc] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:49.234262 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:49.234769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:49.235211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:49.235921 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:49.236384 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:49.236816 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:49.253437 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] HTTP exception thrown: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Request method failure captured: Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc HTTP/1.1 Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxdIayRbamyRfEfP6BbM36tvM44lJ8H11GyaA5HvxPwGgrQHsdE9Px98wZ94MoCNuKRtDk_v20CDunzRUKyv6uGYk71E563PMPl77DVjcEO1aj0uPChKHogPwamHFQybAd_urF2URK5o72HxpCfWjiZw5_kzEDLzeMYb61P0-Sn0OM Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:09:49.255189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c723b1181c94699b389f0fc03e19af6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c723b1181c94699b389f0fc03e19af6"}]}] Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 7dc5501d59fb4593b405f0e9bd2e49ef Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:49.256833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': 'a5aa4f6f-cb29-46ab-b558-e91195e757fc'} Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:49.257712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. Aug 18 11:09:49.259159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:49.260503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Returning 404 to user: Instance a5aa4f6f-cb29-46ab-b558-e91195e757fc could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:49.260503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bb45850e-ef32-4bd6-8422-c92779d85fd8 tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc" status: 404 len: 111 microversion: 2.20 time: 0.038695 Aug 18 11:09:49.260503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 407/796] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:49 2022] GET /compute/v2.1/servers/a5aa4f6f-cb29-46ab-b558-e91195e757fc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:09:50.443973 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:50.444463 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:50.451569 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:50.452057 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:50.452519 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:50.453190 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:50.453715 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:50.454122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:50.468865 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] HTTP exception thrown: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Request method failure captured: Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: DELETE /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b HTTP/1.1 Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hxdIayRbamyRfEfP6BbM36tvM44lJ8H11GyaA5HvxPwGgrQHsdE9Px98wZ94MoCNuKRtDk_v20CDunzRUKyv6uGYk71E563PMPl77DVjcEO1aj0uPChKHogPwamHFQybAd_urF2URK5o72HxpCfWjiZw5_kzEDLzeMYb61P0-Sn0OM Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:09:50.470461 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c723b1181c94699b389f0fc03e19af6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c723b1181c94699b389f0fc03e19af6"}]}] Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 7dc5501d59fb4593b405f0e9bd2e49ef Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:09:50.472122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'e210ba46-e81e-4939-b202-4b569f906d8b'} Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:50.472949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:09:50.474416 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:09:50.475805 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Returning 404 to user: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:50.475805 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c63fbfe2-aa6e-44b5-986e-d850c26cf0cc tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 404 len: 111 microversion: 2.20 time: 0.031757 Aug 18 11:09:50.475805 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 390/797] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Aug 18 11:09:50 2022] DELETE /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:09:50.481255 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:09:50.482666 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] [instance: e210ba46-e81e-4939-b202-4b569f906d8b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:09:50.489238 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:50.489774 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:50.490214 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:50.490913 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:09:50.491371 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:09:50.491798 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:09:50.515046 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] HTTP exception thrown: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Request method failure captured: Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b HTTP/1.1 Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_hxdIayRbamyRfEfP6BbM36tvM44lJ8H11GyaA5HvxPwGgrQHsdE9Px98wZ94MoCNuKRtDk_v20CDunzRUKyv6uGYk71E563PMPl77DVjcEO1aj0uPChKHogPwamHFQybAd_urF2URK5o72HxpCfWjiZw5_kzEDLzeMYb61P0-Sn0OM Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:09:50.516814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c723b1181c94699b389f0fc03e19af6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c723b1181c94699b389f0fc03e19af6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c723b1181c94699b389f0fc03e19af6"}]}] Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 3c723b1181c94699b389f0fc03e19af6 Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-983485587 Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 7dc5501d59fb4593b405f0e9bd2e49ef Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeShelveTestJSON-983485587-project Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:09:50.518454 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': 'e210ba46-e81e-4939-b202-4b569f906d8b'} Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:09:50.519265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. Aug 18 11:09:50.520628 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:09:50.521923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] Returning 404 to user: Instance e210ba46-e81e-4939-b202-4b569f906d8b could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:09:50.521923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b5a4dbfc-45d3-4bf0-8c36-5c09b57d2ecd tempest-AttachVolumeShelveTestJSON-983485587 tempest-AttachVolumeShelveTestJSON-983485587-project] 10.222.0.15 "GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b" status: 404 len: 111 microversion: 2.20 time: 0.040915 Aug 18 11:09:50.521923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 408/798] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Aug 18 11:09:50 2022] GET /compute/v2.1/servers/e210ba46-e81e-4939-b202-4b569f906d8b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:10:00.978398 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1855818385", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:00.986523 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:00.987178 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:01.039212 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] validate_networks() for None {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:10:01.310465 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:10:01.310893 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:10:01.311377 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:10:01.311787 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:10:01.312229 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:10:01.321157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:01.321681 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:01.322119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:01.322875 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:01.323332 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:01.323760 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:01.342423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Getting quotas for project 94bd8c87d54641678bb4f0136a354acc. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:10:01.346422 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Getting quotas for user cf7572ed57244428ae3db89b3b408791 and project 94bd8c87d54641678bb4f0136a354acc. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:10:01.357962 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:10:01.360222 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:10:01.406192 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5d0ddec9-281f-4100-b7b2-962f9d8d5cac tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.431535 Aug 18 11:10:01.406894 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 391/799] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:10:01.421735 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b616e8be-4262-46b5-b209-cace7edf0044 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:01.422336 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b616e8be-4262-46b5-b209-cace7edf0044 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:01.424663 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:01.425307 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:01.482308 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b616e8be-4262-46b5-b209-cace7edf0044 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:01.489470 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b616e8be-4262-46b5-b209-cace7edf0044 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1215 microversion: 2.1 time: 0.071719 Aug 18 11:10:01.490063 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 409/800] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:01 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:02.510433 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fe374dd1-1eeb-43f1-8b59-72f6cfb5f4eb tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:02.511161 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fe374dd1-1eeb-43f1-8b59-72f6cfb5f4eb tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:02.520274 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe374dd1-1eeb-43f1-8b59-72f6cfb5f4eb tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:02.520902 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe374dd1-1eeb-43f1-8b59-72f6cfb5f4eb tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:02.521743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe374dd1-1eeb-43f1-8b59-72f6cfb5f4eb tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:02.523195 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe374dd1-1eeb-43f1-8b59-72f6cfb5f4eb tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:02.524250 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe374dd1-1eeb-43f1-8b59-72f6cfb5f4eb tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:02.525065 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fe374dd1-1eeb-43f1-8b59-72f6cfb5f4eb tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:02.611237 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fe374dd1-1eeb-43f1-8b59-72f6cfb5f4eb tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:02.621724 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fe374dd1-1eeb-43f1-8b59-72f6cfb5f4eb tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1285 microversion: 2.1 time: 0.115222 Aug 18 11:10:02.622694 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 392/801] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:02 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:03.645071 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b4999d30-a403-4a14-aebe-bcd074674336 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:03.646554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b4999d30-a403-4a14-aebe-bcd074674336 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:03.653756 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4999d30-a403-4a14-aebe-bcd074674336 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:03.654370 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4999d30-a403-4a14-aebe-bcd074674336 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:03.655054 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4999d30-a403-4a14-aebe-bcd074674336 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:03.655855 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4999d30-a403-4a14-aebe-bcd074674336 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:03.656704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4999d30-a403-4a14-aebe-bcd074674336 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:03.657663 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b4999d30-a403-4a14-aebe-bcd074674336 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:03.808393 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b4999d30-a403-4a14-aebe-bcd074674336 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:03.816823 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b4999d30-a403-4a14-aebe-bcd074674336 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1315 microversion: 2.1 time: 0.175553 Aug 18 11:10:03.818157 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 410/802] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:03 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:04.035375 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-8a205db6-d1be-4b99-a648-12fbf82ecff1 req-ebcb4761-f83e-4957-ac5d-fc67e033ea5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae18a2fb-6532-4e30-b0c7-3c410dd68070", "tag": "c7520e2d-cc9b-4ecc-b5fb-3b78f4c37cda"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:04.048517 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-8a205db6-d1be-4b99-a648-12fbf82ecff1 req-ebcb4761-f83e-4957-ac5d-fc67e033ea5e service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:04.049155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-8a205db6-d1be-4b99-a648-12fbf82ecff1 req-ebcb4761-f83e-4957-ac5d-fc67e033ea5e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:04.049725 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-8a205db6-d1be-4b99-a648-12fbf82ecff1 req-ebcb4761-f83e-4957-ac5d-fc67e033ea5e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:04.064830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-8a205db6-d1be-4b99-a648-12fbf82ecff1 req-ebcb4761-f83e-4957-ac5d-fc67e033ea5e service nova] Creating event network-changed:c7520e2d-cc9b-4ecc-b5fb-3b78f4c37cda for instance ae18a2fb-6532-4e30-b0c7-3c410dd68070 on hv-cinder-82660 Aug 18 11:10:04.070352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-8a205db6-d1be-4b99-a648-12fbf82ecff1 req-ebcb4761-f83e-4957-ac5d-fc67e033ea5e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041112 Aug 18 11:10:04.071122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 393/803] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:10:04.842890 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d7e61a85-4baa-4709-9d94-4bf2b4524391 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:04.843606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d7e61a85-4baa-4709-9d94-4bf2b4524391 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:04.851956 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d7e61a85-4baa-4709-9d94-4bf2b4524391 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:04.852856 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d7e61a85-4baa-4709-9d94-4bf2b4524391 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:04.853713 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d7e61a85-4baa-4709-9d94-4bf2b4524391 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:04.854866 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d7e61a85-4baa-4709-9d94-4bf2b4524391 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:04.855025 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d7e61a85-4baa-4709-9d94-4bf2b4524391 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:04.855459 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d7e61a85-4baa-4709-9d94-4bf2b4524391 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:05.009592 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-d7e61a85-4baa-4709-9d94-4bf2b4524391 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:05.017077 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-d7e61a85-4baa-4709-9d94-4bf2b4524391 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1315 microversion: 2.1 time: 0.178733 Aug 18 11:10:05.017678 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 411/804] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:04 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:06.042549 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fea16e7a-b524-4b33-897c-3794e13e5ec7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:06.043388 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fea16e7a-b524-4b33-897c-3794e13e5ec7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:06.051460 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea16e7a-b524-4b33-897c-3794e13e5ec7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:06.051995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea16e7a-b524-4b33-897c-3794e13e5ec7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:06.052539 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea16e7a-b524-4b33-897c-3794e13e5ec7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:06.053341 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea16e7a-b524-4b33-897c-3794e13e5ec7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:06.053892 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea16e7a-b524-4b33-897c-3794e13e5ec7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:06.054410 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fea16e7a-b524-4b33-897c-3794e13e5ec7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:06.195927 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fea16e7a-b524-4b33-897c-3794e13e5ec7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:06.203861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fea16e7a-b524-4b33-897c-3794e13e5ec7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1315 microversion: 2.1 time: 0.165441 Aug 18 11:10:06.204528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 394/805] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:06 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:07.225363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-af85ab4d-7d23-4d45-925d-c40841b27f8c tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:07.226005 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-af85ab4d-7d23-4d45-925d-c40841b27f8c tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:07.232753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af85ab4d-7d23-4d45-925d-c40841b27f8c tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:07.233243 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af85ab4d-7d23-4d45-925d-c40841b27f8c tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:07.233789 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af85ab4d-7d23-4d45-925d-c40841b27f8c tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:07.234481 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af85ab4d-7d23-4d45-925d-c40841b27f8c tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:07.234933 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af85ab4d-7d23-4d45-925d-c40841b27f8c tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:07.235357 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af85ab4d-7d23-4d45-925d-c40841b27f8c tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:07.364729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-af85ab4d-7d23-4d45-925d-c40841b27f8c tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:07.372863 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-af85ab4d-7d23-4d45-925d-c40841b27f8c tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1315 microversion: 2.1 time: 0.151384 Aug 18 11:10:07.373532 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 412/806] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:07 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:10:08.393999 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-862684c4-4051-4eb5-86f1-01de7cdf7ee5 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:08.394671 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-862684c4-4051-4eb5-86f1-01de7cdf7ee5 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:08.401002 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-862684c4-4051-4eb5-86f1-01de7cdf7ee5 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:08.401481 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-862684c4-4051-4eb5-86f1-01de7cdf7ee5 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:08.401941 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-862684c4-4051-4eb5-86f1-01de7cdf7ee5 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:08.402625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-862684c4-4051-4eb5-86f1-01de7cdf7ee5 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:08.403705 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-862684c4-4051-4eb5-86f1-01de7cdf7ee5 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:08.404126 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-862684c4-4051-4eb5-86f1-01de7cdf7ee5 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:08.549979 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-862684c4-4051-4eb5-86f1-01de7cdf7ee5 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:08.557629 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-862684c4-4051-4eb5-86f1-01de7cdf7ee5 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1315 microversion: 2.1 time: 0.167503 Aug 18 11:10:08.558197 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 395/807] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:08 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:09.580424 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-f5425ef5-cd8c-4b75-b798-44df197f8ef2 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:09.581148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-f5425ef5-cd8c-4b75-b798-44df197f8ef2 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:09.587706 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5425ef5-cd8c-4b75-b798-44df197f8ef2 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:09.588198 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5425ef5-cd8c-4b75-b798-44df197f8ef2 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:09.588655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5425ef5-cd8c-4b75-b798-44df197f8ef2 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:09.589338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5425ef5-cd8c-4b75-b798-44df197f8ef2 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:09.589917 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5425ef5-cd8c-4b75-b798-44df197f8ef2 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:09.590279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-f5425ef5-cd8c-4b75-b798-44df197f8ef2 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:09.689728 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-6e64e0ce-c6bb-447d-aa2d-473bfe1662b0 req-007ae2de-baf4-4e60-86dd-a32c97539c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae18a2fb-6532-4e30-b0c7-3c410dd68070", "name": "network-vif-plugged", "status": "completed", "tag": "c7520e2d-cc9b-4ecc-b5fb-3b78f4c37cda"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:09.699568 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-6e64e0ce-c6bb-447d-aa2d-473bfe1662b0 req-007ae2de-baf4-4e60-86dd-a32c97539c67 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:09.700717 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-6e64e0ce-c6bb-447d-aa2d-473bfe1662b0 req-007ae2de-baf4-4e60-86dd-a32c97539c67 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:09.701552 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-6e64e0ce-c6bb-447d-aa2d-473bfe1662b0 req-007ae2de-baf4-4e60-86dd-a32c97539c67 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:09.715355 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-6e64e0ce-c6bb-447d-aa2d-473bfe1662b0 req-007ae2de-baf4-4e60-86dd-a32c97539c67 service nova] Creating event network-vif-plugged:c7520e2d-cc9b-4ecc-b5fb-3b78f4c37cda for instance ae18a2fb-6532-4e30-b0c7-3c410dd68070 on hv-cinder-82660 Aug 18 11:10:09.721241 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-6e64e0ce-c6bb-447d-aa2d-473bfe1662b0 req-007ae2de-baf4-4e60-86dd-a32c97539c67 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035125 Aug 18 11:10:09.722175 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 396/808] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:10:09.744469 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-f5425ef5-cd8c-4b75-b798-44df197f8ef2 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:09.755858 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-f5425ef5-cd8c-4b75-b798-44df197f8ef2 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1315 microversion: 2.1 time: 0.179971 Aug 18 11:10:09.771186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 413/809] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:09 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:10.779806 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5e888397-9715-4235-bf5e-de500a8371e4 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:10.780516 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5e888397-9715-4235-bf5e-de500a8371e4 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:10.787193 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e888397-9715-4235-bf5e-de500a8371e4 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:10.787675 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e888397-9715-4235-bf5e-de500a8371e4 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:10.788149 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e888397-9715-4235-bf5e-de500a8371e4 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:10.788854 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e888397-9715-4235-bf5e-de500a8371e4 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:10.789304 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e888397-9715-4235-bf5e-de500a8371e4 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:10.789763 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5e888397-9715-4235-bf5e-de500a8371e4 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:10.931739 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5e888397-9715-4235-bf5e-de500a8371e4 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:10.939550 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5e888397-9715-4235-bf5e-de500a8371e4 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1315 microversion: 2.1 time: 0.164348 Aug 18 11:10:10.940135 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 397/810] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:10 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:10:11.961127 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2794df3e-9338-46ba-8ad6-34708facf7c7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:11.961858 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2794df3e-9338-46ba-8ad6-34708facf7c7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:11.964267 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:11.970211 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2794df3e-9338-46ba-8ad6-34708facf7c7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:11.970707 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2794df3e-9338-46ba-8ad6-34708facf7c7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:11.971144 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2794df3e-9338-46ba-8ad6-34708facf7c7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:11.971940 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2794df3e-9338-46ba-8ad6-34708facf7c7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:11.972426 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2794df3e-9338-46ba-8ad6-34708facf7c7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:11.972953 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2794df3e-9338-46ba-8ad6-34708facf7c7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:12.111338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-2794df3e-9338-46ba-8ad6-34708facf7c7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:12.119207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2794df3e-9338-46ba-8ad6-34708facf7c7 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1464 microversion: 2.1 time: 0.161882 Aug 18 11:10:12.119785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 414/811] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:11 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:12.165058 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-29f2b15b-da97-45b9-9f2d-fca01daa298a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:12.165569 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-29f2b15b-da97-45b9-9f2d-fca01daa298a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:12.167532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:12.168183 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=6 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:12.176250 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29f2b15b-da97-45b9-9f2d-fca01daa298a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:12.176663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29f2b15b-da97-45b9-9f2d-fca01daa298a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:12.177285 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29f2b15b-da97-45b9-9f2d-fca01daa298a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:12.178204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29f2b15b-da97-45b9-9f2d-fca01daa298a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:12.178660 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29f2b15b-da97-45b9-9f2d-fca01daa298a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:12.179088 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-29f2b15b-da97-45b9-9f2d-fca01daa298a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:12.206211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-29f2b15b-da97-45b9-9f2d-fca01daa298a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:10:12.290225 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-29f2b15b-da97-45b9-9f2d-fca01daa298a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 204 len: 0 microversion: 2.1 time: 0.128553 Aug 18 11:10:12.290952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 398/812] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:10:12 2022] DELETE /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:12.300734 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-fd03fcd4-7e9a-49dc-8db2-262472980349 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:12.301375 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-fd03fcd4-7e9a-49dc-8db2-262472980349 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:12.307511 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd03fcd4-7e9a-49dc-8db2-262472980349 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:12.307996 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd03fcd4-7e9a-49dc-8db2-262472980349 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:12.308431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd03fcd4-7e9a-49dc-8db2-262472980349 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:12.309128 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd03fcd4-7e9a-49dc-8db2-262472980349 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:12.309605 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd03fcd4-7e9a-49dc-8db2-262472980349 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:12.310032 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-fd03fcd4-7e9a-49dc-8db2-262472980349 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:12.448152 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-fd03fcd4-7e9a-49dc-8db2-262472980349 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:12.459766 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-fd03fcd4-7e9a-49dc-8db2-262472980349 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1470 microversion: 2.1 time: 0.162747 Aug 18 11:10:12.460425 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 415/813] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:12 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:13.483694 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-27792a2f-b7fe-4d4e-8780-e148b242f738 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:13.484303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-27792a2f-b7fe-4d4e-8780-e148b242f738 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:13.490693 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-27792a2f-b7fe-4d4e-8780-e148b242f738 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:13.491173 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-27792a2f-b7fe-4d4e-8780-e148b242f738 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:13.491608 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-27792a2f-b7fe-4d4e-8780-e148b242f738 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:13.492298 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-27792a2f-b7fe-4d4e-8780-e148b242f738 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:13.492745 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-27792a2f-b7fe-4d4e-8780-e148b242f738 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:13.493165 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-27792a2f-b7fe-4d4e-8780-e148b242f738 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:13.632093 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-27792a2f-b7fe-4d4e-8780-e148b242f738 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:13.640303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-27792a2f-b7fe-4d4e-8780-e148b242f738 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1470 microversion: 2.1 time: 0.161895 Aug 18 11:10:13.640951 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 399/814] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:13 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:14.662092 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c1e0614a-578e-4c7e-8510-9dac5712577a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:14.662629 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c1e0614a-578e-4c7e-8510-9dac5712577a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:14.669891 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1e0614a-578e-4c7e-8510-9dac5712577a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:14.670637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1e0614a-578e-4c7e-8510-9dac5712577a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:14.671074 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1e0614a-578e-4c7e-8510-9dac5712577a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:14.671775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1e0614a-578e-4c7e-8510-9dac5712577a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:14.672234 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1e0614a-578e-4c7e-8510-9dac5712577a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:14.672684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1e0614a-578e-4c7e-8510-9dac5712577a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:14.816659 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c1e0614a-578e-4c7e-8510-9dac5712577a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7572ed57244428ae3db89b3b408791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94bd8c87d54641678bb4f0136a354acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:14.825876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c1e0614a-578e-4c7e-8510-9dac5712577a tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 200 len: 1470 microversion: 2.1 time: 0.167514 Aug 18 11:10:14.839903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 416/815] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:14 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:14.956738 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-98e08fa7-d0c5-4a07-afcc-6ec1767762bc req-7026b040-0dc5-4ded-bbb9-928c1e668a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae18a2fb-6532-4e30-b0c7-3c410dd68070", "name": "network-vif-deleted", "tag": "c7520e2d-cc9b-4ecc-b5fb-3b78f4c37cda"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:14.969832 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-98e08fa7-d0c5-4a07-afcc-6ec1767762bc req-7026b040-0dc5-4ded-bbb9-928c1e668a71 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:14.970885 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-98e08fa7-d0c5-4a07-afcc-6ec1767762bc req-7026b040-0dc5-4ded-bbb9-928c1e668a71 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:14.972271 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-98e08fa7-d0c5-4a07-afcc-6ec1767762bc req-7026b040-0dc5-4ded-bbb9-928c1e668a71 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:14.985937 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-98e08fa7-d0c5-4a07-afcc-6ec1767762bc req-7026b040-0dc5-4ded-bbb9-928c1e668a71 service nova] Creating event network-vif-deleted:c7520e2d-cc9b-4ecc-b5fb-3b78f4c37cda for instance ae18a2fb-6532-4e30-b0c7-3c410dd68070 on hv-cinder-82660 Aug 18 11:10:14.991376 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-98e08fa7-d0c5-4a07-afcc-6ec1767762bc req-7026b040-0dc5-4ded-bbb9-928c1e668a71 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039637 Aug 18 11:10:14.992269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 400/816] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:10:15.374857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e0ce08f8-c62b-492b-b524-e82009a8276f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:15.375484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e0ce08f8-c62b-492b-b524-e82009a8276f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:15.394768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0ce08f8-c62b-492b-b524-e82009a8276f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:15.396482 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0ce08f8-c62b-492b-b524-e82009a8276f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:15.397022 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0ce08f8-c62b-492b-b524-e82009a8276f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:15.397890 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0ce08f8-c62b-492b-b524-e82009a8276f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:15.398358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0ce08f8-c62b-492b-b524-e82009a8276f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:15.398790 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e0ce08f8-c62b-492b-b524-e82009a8276f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:15.435941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e0ce08f8-c62b-492b-b524-e82009a8276f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Going to try to terminate instance {{(pid=120800) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:10:15.539984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e0ce08f8-c62b-492b-b524-e82009a8276f tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "DELETE /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 204 len: 0 microversion: 2.1 time: 0.170503 Aug 18 11:10:15.545457 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 417/817] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:10:15 2022] DELETE /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:15.550806 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-91ab0dd8-29b7-4d3e-9452-03193f5bd247 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:15.551505 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-91ab0dd8-29b7-4d3e-9452-03193f5bd247 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:15.562449 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-91ab0dd8-29b7-4d3e-9452-03193f5bd247 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:15.562939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-91ab0dd8-29b7-4d3e-9452-03193f5bd247 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:15.563554 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-91ab0dd8-29b7-4d3e-9452-03193f5bd247 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:15.564251 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-91ab0dd8-29b7-4d3e-9452-03193f5bd247 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:15.564724 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-91ab0dd8-29b7-4d3e-9452-03193f5bd247 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:15.565123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-91ab0dd8-29b7-4d3e-9452-03193f5bd247 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:15.719512 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-91ab0dd8-29b7-4d3e-9452-03193f5bd247 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:15.727584 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-91ab0dd8-29b7-4d3e-9452-03193f5bd247 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.180851 Aug 18 11:10:15.728151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 401/818] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:15 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:15.849354 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:15.850104 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] [instance: ae18a2fb-6532-4e30-b0c7-3c410dd68070] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:15.858390 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:15.858925 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:15.859700 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:15.860444 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:15.860937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:15.861465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:15.877788 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] HTTP exception thrown: Instance ae18a2fb-6532-4e30-b0c7-3c410dd68070 could not be found. Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Request method failure captured: Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 HTTP/1.1 Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_h4HrK3rzJu3WVNInTyeY6e5SyLRUyeeHkOU_yUF-tWReRZlfoLsoz8rjqh67h0G5iVk0xz00iwGggxYxnLQlsGIFdtMkSLY8wKpINHtYhcNPmmKuRluQkyGKLnxBf7LOebqL505kReBfq4oza-Sa0ZxrgO-RoqXZFkHyv70Yy8GgT0 Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 94bd8c87d54641678bb4f0136a354acc Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-VolumesNegativeTest-1122420077 Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:10:15.879433 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_94bd8c87d54641678bb4f0136a354acc", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94bd8c87d54641678bb4f0136a354acc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/94bd8c87d54641678bb4f0136a354acc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/94bd8c87d54641678bb4f0136a354acc"}]}] Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-VolumesNegativeTest-1122420077 Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 94bd8c87d54641678bb4f0136a354acc Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-VolumesNegativeTest-1122420077 Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-VolumesNegativeTest-1122420077-project Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: cf7572ed57244428ae3db89b3b408791 Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-VolumesNegativeTest-1122420077-project Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance ae18a2fb-6532-4e30-b0c7-3c410dd68070 could not be found. Aug 18 11:10:15.881232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': 'ae18a2fb-6532-4e30-b0c7-3c410dd68070'} Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae18a2fb-6532-4e30-b0c7-3c410dd68070 could not be found. Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:10:15.882129 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae18a2fb-6532-4e30-b0c7-3c410dd68070 could not be found. Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae18a2fb-6532-4e30-b0c7-3c410dd68070 could not be found. Aug 18 11:10:15.884266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:10:15.885429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] Returning 404 to user: Instance ae18a2fb-6532-4e30-b0c7-3c410dd68070 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:10:15.885429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c0529f3d-7623-47e2-ab2e-697a7bac2cf1 tempest-VolumesNegativeTest-1122420077 tempest-VolumesNegativeTest-1122420077-project] 10.222.0.15 "GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070" status: 404 len: 111 microversion: 2.1 time: 0.036467 Aug 18 11:10:15.885429 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 418/819] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:15 2022] GET /compute/v2.1/servers/ae18a2fb-6532-4e30-b0c7-3c410dd68070 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:10:16.751981 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-366813e5-19a4-4d12-b34a-a20c7f67a730 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:16.753269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-366813e5-19a4-4d12-b34a-a20c7f67a730 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:16.760464 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-366813e5-19a4-4d12-b34a-a20c7f67a730 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:16.761435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-366813e5-19a4-4d12-b34a-a20c7f67a730 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:16.763076 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-366813e5-19a4-4d12-b34a-a20c7f67a730 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:16.763913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-366813e5-19a4-4d12-b34a-a20c7f67a730 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:16.764619 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-366813e5-19a4-4d12-b34a-a20c7f67a730 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:16.765157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-366813e5-19a4-4d12-b34a-a20c7f67a730 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:16.938036 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-366813e5-19a4-4d12-b34a-a20c7f67a730 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:16.945996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-366813e5-19a4-4d12-b34a-a20c7f67a730 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.197985 Aug 18 11:10:16.946567 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 402/820] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:16 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:17.011525 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-0fd6ee82-23ed-4332-8573-76ce863ccd65 req-78270254-2a08-430e-8bc7-51af7074c46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192f88e2-9697-4492-ac5f-83e871070136", "tag": "8f8c3d63-26c6-4e2b-9922-666ae0de919b"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:17.022466 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0fd6ee82-23ed-4332-8573-76ce863ccd65 req-78270254-2a08-430e-8bc7-51af7074c46b service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:17.023011 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0fd6ee82-23ed-4332-8573-76ce863ccd65 req-78270254-2a08-430e-8bc7-51af7074c46b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:17.023462 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0fd6ee82-23ed-4332-8573-76ce863ccd65 req-78270254-2a08-430e-8bc7-51af7074c46b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:17.035812 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-0fd6ee82-23ed-4332-8573-76ce863ccd65 req-78270254-2a08-430e-8bc7-51af7074c46b service nova] Creating event network-changed:8f8c3d63-26c6-4e2b-9922-666ae0de919b for instance 192f88e2-9697-4492-ac5f-83e871070136 on hv-cinder-82660 Aug 18 11:10:17.040946 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-0fd6ee82-23ed-4332-8573-76ce863ccd65 req-78270254-2a08-430e-8bc7-51af7074c46b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035530 Aug 18 11:10:17.041598 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 419/821] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:10:17.972423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ddc1faf4-be34-4fd1-b593-4d0b37353488 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:17.973960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ddc1faf4-be34-4fd1-b593-4d0b37353488 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:17.988274 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ddc1faf4-be34-4fd1-b593-4d0b37353488 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:17.990703 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ddc1faf4-be34-4fd1-b593-4d0b37353488 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:17.991948 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ddc1faf4-be34-4fd1-b593-4d0b37353488 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:17.992192 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ddc1faf4-be34-4fd1-b593-4d0b37353488 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:17.993071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ddc1faf4-be34-4fd1-b593-4d0b37353488 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:17.993842 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ddc1faf4-be34-4fd1-b593-4d0b37353488 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:18.368645 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ddc1faf4-be34-4fd1-b593-4d0b37353488 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6e7022d0e4c4b00b92f12a65963d9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20ffd1ca0c94a9285f1fad07e8ab39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:18.393609 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ddc1faf4-be34-4fd1-b593-4d0b37353488 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 200 len: 1569 microversion: 2.1 time: 0.429203 Aug 18 11:10:18.400612 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 403/822] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:17 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 1569 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:19.060893 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-bbe71f86-b66e-4ef3-9e9e-2116343ee50d req-19f6b2e5-0dec-40dd-8cd9-206a6d6c4d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192f88e2-9697-4492-ac5f-83e871070136", "name": "network-vif-deleted", "tag": "8f8c3d63-26c6-4e2b-9922-666ae0de919b"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:19.071852 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-bbe71f86-b66e-4ef3-9e9e-2116343ee50d req-19f6b2e5-0dec-40dd-8cd9-206a6d6c4d95 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:19.072331 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-bbe71f86-b66e-4ef3-9e9e-2116343ee50d req-19f6b2e5-0dec-40dd-8cd9-206a6d6c4d95 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:19.072755 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-bbe71f86-b66e-4ef3-9e9e-2116343ee50d req-19f6b2e5-0dec-40dd-8cd9-206a6d6c4d95 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:19.084941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-bbe71f86-b66e-4ef3-9e9e-2116343ee50d req-19f6b2e5-0dec-40dd-8cd9-206a6d6c4d95 service nova] Creating event network-vif-deleted:8f8c3d63-26c6-4e2b-9922-666ae0de919b for instance 192f88e2-9697-4492-ac5f-83e871070136 on hv-cinder-82660 Aug 18 11:10:19.095798 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-bbe71f86-b66e-4ef3-9e9e-2116343ee50d req-19f6b2e5-0dec-40dd-8cd9-206a6d6c4d95 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035935 Aug 18 11:10:19.095798 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 420/823] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:10:19.422413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:19.423344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] [instance: 192f88e2-9697-4492-ac5f-83e871070136] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:19.429697 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:19.430441 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:19.430876 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:19.431912 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:19.432365 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:19.432782 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:19.447484 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] HTTP exception thrown: Instance 192f88e2-9697-4492-ac5f-83e871070136 could not be found. Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Request method failure captured: Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 HTTP/1.1 Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_hzF6Cka4YHwANVgCxIPLtkVGBbrUufPN4tClhU-Onqm-IuGPRPpBj5bPX-RwfaxNBG0Suf-0LlgU09yGDNK8gbHP1oGTm_7hYQoIauNTrfFyOPoaEFofoU6yZ6w5jdXLdkAa94pFFYtvpLfxIMQuZH8fH7lxr53mSUlMnjbr0rrCYk Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: f20ffd1ca0c94a9285f1fad07e8ab39a Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-TestShelveInstance-1728187964 Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:10:19.448965 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f20ffd1ca0c94a9285f1fad07e8ab39a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f20ffd1ca0c94a9285f1fad07e8ab39a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f20ffd1ca0c94a9285f1fad07e8ab39a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f20ffd1ca0c94a9285f1fad07e8ab39a"}]}] Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-TestShelveInstance-1728187964 Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: f20ffd1ca0c94a9285f1fad07e8ab39a Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-TestShelveInstance-1728187964 Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-TestShelveInstance-1728187964-project Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: b6e7022d0e4c4b00b92f12a65963d9e9 Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-TestShelveInstance-1728187964-project Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 192f88e2-9697-4492-ac5f-83e871070136 could not be found. Aug 18 11:10:19.451214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '192f88e2-9697-4492-ac5f-83e871070136'} Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 192f88e2-9697-4492-ac5f-83e871070136 could not be found. Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:10:19.452037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 192f88e2-9697-4492-ac5f-83e871070136 could not be found. Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 192f88e2-9697-4492-ac5f-83e871070136 could not be found. Aug 18 11:10:19.453210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:10:19.454354 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Returning 404 to user: Instance 192f88e2-9697-4492-ac5f-83e871070136 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:10:19.454354 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9edaa3d6-f16f-4405-b856-7b49895f5439 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136" status: 404 len: 111 microversion: 2.1 time: 0.033102 Aug 18 11:10:19.454354 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 404/824] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:19 2022] GET /compute/v2.1/servers/192f88e2-9697-4492-ac5f-83e871070136 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:10:19.633240 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1c48cde6-3699-405d-8f5e-f441a6ee8ed7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] Calling method '.version_select at 0x7f7ec8983af0>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:19.659266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1c48cde6-3699-405d-8f5e-f441a6ee8ed7 tempest-TestShelveInstance-1728187964 tempest-TestShelveInstance-1728187964-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1320507456" status: 202 len: 0 microversion: 2.1 time: 0.034189 Aug 18 11:10:19.660200 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 421/825] 10.222.0.15 () {58 vars in 1254 bytes} [Thu Aug 18 11:10:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1320507456 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:10:20.512014 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-99d98733-5b0e-4d35-b1cf-225b6ec75d3c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:20.513212 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-99d98733-5b0e-4d35-b1cf-225b6ec75d3c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:20.526078 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-99d98733-5b0e-4d35-b1cf-225b6ec75d3c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:20.526827 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-99d98733-5b0e-4d35-b1cf-225b6ec75d3c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:20.527423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-99d98733-5b0e-4d35-b1cf-225b6ec75d3c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:20.528381 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-99d98733-5b0e-4d35-b1cf-225b6ec75d3c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:20.529231 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-99d98733-5b0e-4d35-b1cf-225b6ec75d3c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:20.529853 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-99d98733-5b0e-4d35-b1cf-225b6ec75d3c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:20.629489 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-99d98733-5b0e-4d35-b1cf-225b6ec75d3c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lazy-loading 'services' on Instance uuid 4584500a-8d03-4227-ac47-c7ea8b80d2ce {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:10:20.753997 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-99d98733-5b0e-4d35-b1cf-225b6ec75d3c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/os-volume_attachments/7f9d99dc-6a21-4e1b-87dc-e249ea8036de" status: 202 len: 0 microversion: 2.1 time: 0.251262 Aug 18 11:10:20.774090 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 405/826] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:10:20 2022] DELETE /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/os-volume_attachments/7f9d99dc-6a21-4e1b-87dc-e249ea8036de => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:10:21.979726 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-07006eda-c91d-452c-a280-58145701434e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:21.988333 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-07006eda-c91d-452c-a280-58145701434e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:21.989153 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-07006eda-c91d-452c-a280-58145701434e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:21.990137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-07006eda-c91d-452c-a280-58145701434e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:22.022258 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-07006eda-c91d-452c-a280-58145701434e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Going to try to stop instance {{(pid=120800) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:10:22.112746 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-07006eda-c91d-452c-a280-58145701434e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/action" status: 202 len: 0 microversion: 2.1 time: 0.137207 Aug 18 11:10:22.113963 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 422/827] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:10:21 2022] POST /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:10:22.131078 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a8284c91-0ac4-4661-bcb2-03413c83cb52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:22.131769 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a8284c91-0ac4-4661-bcb2-03413c83cb52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:22.140787 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a8284c91-0ac4-4661-bcb2-03413c83cb52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:22.141277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a8284c91-0ac4-4661-bcb2-03413c83cb52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:22.144555 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a8284c91-0ac4-4661-bcb2-03413c83cb52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:22.148581 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a8284c91-0ac4-4661-bcb2-03413c83cb52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:22.149303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a8284c91-0ac4-4661-bcb2-03413c83cb52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:22.149943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a8284c91-0ac4-4661-bcb2-03413c83cb52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:22.393981 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a8284c91-0ac4-4661-bcb2-03413c83cb52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:22.406427 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a8284c91-0ac4-4661-bcb2-03413c83cb52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1679 microversion: 2.1 time: 0.287639 Aug 18 11:10:22.407035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 406/828] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:22 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1679 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:23.429388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-cfaf26cb-fd6d-4cfc-bb8a-8540832390c8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:23.430120 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-cfaf26cb-fd6d-4cfc-bb8a-8540832390c8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:23.447335 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cfaf26cb-fd6d-4cfc-bb8a-8540832390c8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:23.447839 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cfaf26cb-fd6d-4cfc-bb8a-8540832390c8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:23.448314 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cfaf26cb-fd6d-4cfc-bb8a-8540832390c8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:23.451346 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cfaf26cb-fd6d-4cfc-bb8a-8540832390c8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:23.451848 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cfaf26cb-fd6d-4cfc-bb8a-8540832390c8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:23.452278 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cfaf26cb-fd6d-4cfc-bb8a-8540832390c8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:23.807031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cfaf26cb-fd6d-4cfc-bb8a-8540832390c8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:23.821702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-cfaf26cb-fd6d-4cfc-bb8a-8540832390c8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1679 microversion: 2.1 time: 0.396950 Aug 18 11:10:23.834461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 423/829] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:23 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1679 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:24.853033 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ce411965-97dd-4f3b-8c9d-9967468202b7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:24.853687 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ce411965-97dd-4f3b-8c9d-9967468202b7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:24.864121 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce411965-97dd-4f3b-8c9d-9967468202b7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:24.864666 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce411965-97dd-4f3b-8c9d-9967468202b7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:24.865116 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce411965-97dd-4f3b-8c9d-9967468202b7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:24.869242 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce411965-97dd-4f3b-8c9d-9967468202b7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:24.869776 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce411965-97dd-4f3b-8c9d-9967468202b7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:24.870226 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ce411965-97dd-4f3b-8c9d-9967468202b7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:25.316014 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ce411965-97dd-4f3b-8c9d-9967468202b7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:25.326917 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ce411965-97dd-4f3b-8c9d-9967468202b7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1679 microversion: 2.1 time: 0.478008 Aug 18 11:10:25.341142 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 407/830] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:24 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1679 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:26.348288 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-af8a3ecf-c162-47bd-838c-4c9c079c28b3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:26.348894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-af8a3ecf-c162-47bd-838c-4c9c079c28b3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:26.357757 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af8a3ecf-c162-47bd-838c-4c9c079c28b3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:26.358721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af8a3ecf-c162-47bd-838c-4c9c079c28b3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:26.361697 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af8a3ecf-c162-47bd-838c-4c9c079c28b3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:26.362672 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af8a3ecf-c162-47bd-838c-4c9c079c28b3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:26.363317 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af8a3ecf-c162-47bd-838c-4c9c079c28b3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:26.363917 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af8a3ecf-c162-47bd-838c-4c9c079c28b3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:26.524785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-af8a3ecf-c162-47bd-838c-4c9c079c28b3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:26.535410 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-af8a3ecf-c162-47bd-838c-4c9c079c28b3 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1679 microversion: 2.1 time: 0.190800 Aug 18 11:10:26.536252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 424/831] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:26 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:27.558108 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a4730e59-0990-4cb9-b118-92923d643b8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:27.558674 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a4730e59-0990-4cb9-b118-92923d643b8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:27.566809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4730e59-0990-4cb9-b118-92923d643b8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:27.567295 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4730e59-0990-4cb9-b118-92923d643b8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:27.567928 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4730e59-0990-4cb9-b118-92923d643b8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:27.568637 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4730e59-0990-4cb9-b118-92923d643b8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:27.569094 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4730e59-0990-4cb9-b118-92923d643b8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:27.569535 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4730e59-0990-4cb9-b118-92923d643b8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:27.598682 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:28.279126 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a4730e59-0990-4cb9-b118-92923d643b8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:28.297074 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a4730e59-0990-4cb9-b118-92923d643b8b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1679 microversion: 2.1 time: 0.744144 Aug 18 11:10:28.302148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 408/832] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:27 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1679 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:10:29.328243 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-308d2988-e5a7-4e27-b724-c543973b3ec8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:29.328962 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-308d2988-e5a7-4e27-b724-c543973b3ec8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:29.339313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-308d2988-e5a7-4e27-b724-c543973b3ec8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:29.340196 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-308d2988-e5a7-4e27-b724-c543973b3ec8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:29.341151 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-308d2988-e5a7-4e27-b724-c543973b3ec8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:29.347924 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-308d2988-e5a7-4e27-b724-c543973b3ec8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:29.349858 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-308d2988-e5a7-4e27-b724-c543973b3ec8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:29.351055 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-308d2988-e5a7-4e27-b724-c543973b3ec8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:29.805951 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-308d2988-e5a7-4e27-b724-c543973b3ec8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:29.821690 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-308d2988-e5a7-4e27-b724-c543973b3ec8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1679 microversion: 2.1 time: 0.498850 Aug 18 11:10:29.822684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 425/833] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:29 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1679 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:30.845644 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e55de8c4-a084-42c0-a0d2-5ac8f5be0951 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:30.846305 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e55de8c4-a084-42c0-a0d2-5ac8f5be0951 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:30.854764 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e55de8c4-a084-42c0-a0d2-5ac8f5be0951 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:30.856203 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e55de8c4-a084-42c0-a0d2-5ac8f5be0951 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:30.856651 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e55de8c4-a084-42c0-a0d2-5ac8f5be0951 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:30.857372 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e55de8c4-a084-42c0-a0d2-5ac8f5be0951 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:30.857898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e55de8c4-a084-42c0-a0d2-5ac8f5be0951 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:30.858323 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e55de8c4-a084-42c0-a0d2-5ac8f5be0951 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:31.018272 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e55de8c4-a084-42c0-a0d2-5ac8f5be0951 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:31.029149 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e55de8c4-a084-42c0-a0d2-5ac8f5be0951 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1679 microversion: 2.1 time: 0.189106 Aug 18 11:10:31.030071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 409/834] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:30 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:32.051293 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d1addabe-7d49-4601-b83b-f86f95c6d534 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:32.052692 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d1addabe-7d49-4601-b83b-f86f95c6d534 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:32.055512 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:32.062328 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d1addabe-7d49-4601-b83b-f86f95c6d534 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:32.063212 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d1addabe-7d49-4601-b83b-f86f95c6d534 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:32.063825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d1addabe-7d49-4601-b83b-f86f95c6d534 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:32.064702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d1addabe-7d49-4601-b83b-f86f95c6d534 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:32.065312 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d1addabe-7d49-4601-b83b-f86f95c6d534 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:32.065918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d1addabe-7d49-4601-b83b-f86f95c6d534 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:32.094655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:32.221756 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-d1addabe-7d49-4601-b83b-f86f95c6d534 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:32.231564 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-d1addabe-7d49-4601-b83b-f86f95c6d534 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1679 microversion: 2.1 time: 0.184619 Aug 18 11:10:32.232459 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 426/835] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:32 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:33.258842 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0a4a1f2b-ee24-452f-9518-9611d43f6bd0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:33.260289 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0a4a1f2b-ee24-452f-9518-9611d43f6bd0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:33.270621 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:33.272424 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0a4a1f2b-ee24-452f-9518-9611d43f6bd0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:33.273145 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0a4a1f2b-ee24-452f-9518-9611d43f6bd0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:33.273961 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0a4a1f2b-ee24-452f-9518-9611d43f6bd0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:33.275614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0a4a1f2b-ee24-452f-9518-9611d43f6bd0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:33.276311 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0a4a1f2b-ee24-452f-9518-9611d43f6bd0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:33.276983 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0a4a1f2b-ee24-452f-9518-9611d43f6bd0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:33.530762 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0a4a1f2b-ee24-452f-9518-9611d43f6bd0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:33.545035 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0a4a1f2b-ee24-452f-9518-9611d43f6bd0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1656 microversion: 2.1 time: 0.290249 Aug 18 11:10:33.558254 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 410/836] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:33 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1656 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:33.567405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e3eaa30d-9054-4889-8781-820dc23144a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:33.575065 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3eaa30d-9054-4889-8781-820dc23144a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:33.575307 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3eaa30d-9054-4889-8781-820dc23144a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:33.575612 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3eaa30d-9054-4889-8781-820dc23144a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:33.604603 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e3eaa30d-9054-4889-8781-820dc23144a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Going to try to start instance {{(pid=120800) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 11:10:33.661051 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e3eaa30d-9054-4889-8781-820dc23144a8 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/action" status: 202 len: 0 microversion: 2.1 time: 0.097291 Aug 18 11:10:33.661966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 427/837] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:10:33 2022] POST /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:10:33.673005 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-59b8c712-154f-448e-85fc-d4694f494c4d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:33.674020 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-59b8c712-154f-448e-85fc-d4694f494c4d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:33.688216 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59b8c712-154f-448e-85fc-d4694f494c4d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:33.688851 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59b8c712-154f-448e-85fc-d4694f494c4d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:33.689490 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59b8c712-154f-448e-85fc-d4694f494c4d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:33.690424 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59b8c712-154f-448e-85fc-d4694f494c4d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:33.691088 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59b8c712-154f-448e-85fc-d4694f494c4d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:33.693843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59b8c712-154f-448e-85fc-d4694f494c4d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:33.971552 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-59b8c712-154f-448e-85fc-d4694f494c4d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:33.981111 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-59b8c712-154f-448e-85fc-d4694f494c4d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1665 microversion: 2.1 time: 0.313569 Aug 18 11:10:33.982098 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 411/838] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:33 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1665 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:35.006318 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-605a3e78-4b81-43cd-8082-5e718f7a1d01 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:35.007019 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-605a3e78-4b81-43cd-8082-5e718f7a1d01 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:35.018630 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-605a3e78-4b81-43cd-8082-5e718f7a1d01 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:35.019123 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-605a3e78-4b81-43cd-8082-5e718f7a1d01 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:35.019556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-605a3e78-4b81-43cd-8082-5e718f7a1d01 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:35.024196 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-605a3e78-4b81-43cd-8082-5e718f7a1d01 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:35.024873 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-605a3e78-4b81-43cd-8082-5e718f7a1d01 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:35.025448 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-605a3e78-4b81-43cd-8082-5e718f7a1d01 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:35.237587 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-605a3e78-4b81-43cd-8082-5e718f7a1d01 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:35.246123 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-605a3e78-4b81-43cd-8082-5e718f7a1d01 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1665 microversion: 2.1 time: 0.243895 Aug 18 11:10:35.247259 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 428/839] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:35 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1665 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:36.268081 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b21e2a7a-9d7c-4e17-a901-2782c97eb2e9 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:36.268601 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b21e2a7a-9d7c-4e17-a901-2782c97eb2e9 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:36.275818 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b21e2a7a-9d7c-4e17-a901-2782c97eb2e9 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:36.276313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b21e2a7a-9d7c-4e17-a901-2782c97eb2e9 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:36.279807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b21e2a7a-9d7c-4e17-a901-2782c97eb2e9 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:36.280575 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b21e2a7a-9d7c-4e17-a901-2782c97eb2e9 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:36.281209 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b21e2a7a-9d7c-4e17-a901-2782c97eb2e9 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:36.281900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b21e2a7a-9d7c-4e17-a901-2782c97eb2e9 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:36.446048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b21e2a7a-9d7c-4e17-a901-2782c97eb2e9 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:36.458168 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b21e2a7a-9d7c-4e17-a901-2782c97eb2e9 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1669 microversion: 2.1 time: 0.193582 Aug 18 11:10:36.459443 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 412/840] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:36 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1669 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:43.051326 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-20ee469e-38ec-4c4a-bf75-5121aca294c3 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Action: 'create', calling method: .version_select at 0x7f7ec8983d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-618543521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNshbY0vus0GvfqNy+9r/nQ4ZFApiR3TPhvfjibouzC5N4SVFlkh89GpsoDUCtFkBw7gibszNLlKOryZhBomeLrBWG1oJ9SgHmnX5AFlWEUTBO6sjh4jdK6clPCOH3dw+g=="}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:43.067699 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-20ee469e-38ec-4c4a-bf75-5121aca294c3 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Getting quotas for project 2b0506e20fb94a929cf6703c6a52f8d2. Resources: {'key_pairs'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:10:43.072028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-20ee469e-38ec-4c4a-bf75-5121aca294c3 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Getting quotas for user 937b232bfc72467c96829aff438cdecb and project 2b0506e20fb94a929cf6703c6a52f8d2. Resources: {'key_pairs'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:10:43.102192 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-20ee469e-38ec-4c4a-bf75-5121aca294c3 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054687 Aug 18 11:10:43.102804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 429/841] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Aug 18 11:10:43 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:10:43.188531 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1812479048", "imageRef": "9354dcfd-2323-4c67-bde2-e66a3d42e895", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-618543521", "networks": [{"uuid": "c512613d-6cba-4322-babd-df41eea5dfc3"}]}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:43.242226 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] validate_networks() for [('c512613d-6cba-4322-babd-df41eea5dfc3', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:10:43.615067 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:10:43.615492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:10:43.615964 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:10:43.616372 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:10:43.616782 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:10:43.625688 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:43.626170 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:43.626603 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:43.627326 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:43.627774 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:43.628221 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:43.645330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Getting quotas for project 2b0506e20fb94a929cf6703c6a52f8d2. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:10:43.649249 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Getting quotas for user 937b232bfc72467c96829aff438cdecb and project 2b0506e20fb94a929cf6703c6a52f8d2. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:10:43.661445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:10:43.663658 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9354dcfd-2323-4c67-bde2-e66a3d42e895',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:10:43.712401 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e7e58c0a-c7e0-49e2-9a9b-0f9efa8dc370 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528472 Aug 18 11:10:43.713215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 413/842] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:10:43.723795 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-854a7126-4b8d-4b83-a3f6-a6f561f9786d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:43.724399 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-854a7126-4b8d-4b83-a3f6-a6f561f9786d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:43.782961 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-854a7126-4b8d-4b83-a3f6-a6f561f9786d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:43.790206 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-854a7126-4b8d-4b83-a3f6-a6f561f9786d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1258 microversion: 2.1 time: 0.070150 Aug 18 11:10:43.790773 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 430/843] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:43 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:44.812514 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0cb03d7c-03ba-47ee-8c6e-a92a7e220665 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:44.813227 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0cb03d7c-03ba-47ee-8c6e-a92a7e220665 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:44.820248 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0cb03d7c-03ba-47ee-8c6e-a92a7e220665 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:44.820881 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0cb03d7c-03ba-47ee-8c6e-a92a7e220665 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:44.821460 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0cb03d7c-03ba-47ee-8c6e-a92a7e220665 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:44.822219 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0cb03d7c-03ba-47ee-8c6e-a92a7e220665 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:44.822842 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0cb03d7c-03ba-47ee-8c6e-a92a7e220665 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:44.824816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0cb03d7c-03ba-47ee-8c6e-a92a7e220665 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:44.895085 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0cb03d7c-03ba-47ee-8c6e-a92a7e220665 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:44.903896 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0cb03d7c-03ba-47ee-8c6e-a92a7e220665 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1316 microversion: 2.1 time: 0.096118 Aug 18 11:10:44.904581 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 414/844] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:44 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1316 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:45.927570 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0b92e5d1-a822-43bc-9026-54de87763d27 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:45.928186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0b92e5d1-a822-43bc-9026-54de87763d27 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:45.930848 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:45.937220 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b92e5d1-a822-43bc-9026-54de87763d27 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:45.937750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b92e5d1-a822-43bc-9026-54de87763d27 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:45.938187 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b92e5d1-a822-43bc-9026-54de87763d27 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:45.938897 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b92e5d1-a822-43bc-9026-54de87763d27 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:45.939343 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b92e5d1-a822-43bc-9026-54de87763d27 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:45.939768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0b92e5d1-a822-43bc-9026-54de87763d27 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:46.081867 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0b92e5d1-a822-43bc-9026-54de87763d27 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:46.089748 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0b92e5d1-a822-43bc-9026-54de87763d27 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.165866 Aug 18 11:10:46.091018 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 431/845] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:45 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:47.110651 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-dd1e9fae-4b11-426d-a753-5e73fcceb0a4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:47.111287 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-dd1e9fae-4b11-426d-a753-5e73fcceb0a4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:47.117732 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd1e9fae-4b11-426d-a753-5e73fcceb0a4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:47.118215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd1e9fae-4b11-426d-a753-5e73fcceb0a4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:47.118645 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd1e9fae-4b11-426d-a753-5e73fcceb0a4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:47.119344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd1e9fae-4b11-426d-a753-5e73fcceb0a4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:47.119787 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd1e9fae-4b11-426d-a753-5e73fcceb0a4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:47.120211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd1e9fae-4b11-426d-a753-5e73fcceb0a4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:47.263415 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-dd1e9fae-4b11-426d-a753-5e73fcceb0a4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:47.271423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-dd1e9fae-4b11-426d-a753-5e73fcceb0a4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.164491 Aug 18 11:10:47.271996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 415/846] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:47 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:48.295528 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3e508781-cb38-48a3-8e3d-36977f7a75cb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:48.296393 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3e508781-cb38-48a3-8e3d-36977f7a75cb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:48.302961 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e508781-cb38-48a3-8e3d-36977f7a75cb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:48.303450 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e508781-cb38-48a3-8e3d-36977f7a75cb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:48.303882 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e508781-cb38-48a3-8e3d-36977f7a75cb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:48.304583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e508781-cb38-48a3-8e3d-36977f7a75cb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:48.305042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e508781-cb38-48a3-8e3d-36977f7a75cb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:48.305467 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e508781-cb38-48a3-8e3d-36977f7a75cb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:48.447923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3e508781-cb38-48a3-8e3d-36977f7a75cb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:48.456087 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3e508781-cb38-48a3-8e3d-36977f7a75cb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.166164 Aug 18 11:10:48.470452 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 432/847] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:48 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:49.478307 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5663d4dd-b83f-4bae-ab3f-3be0443320eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:49.479054 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5663d4dd-b83f-4bae-ab3f-3be0443320eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:49.489333 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5663d4dd-b83f-4bae-ab3f-3be0443320eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:49.489811 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5663d4dd-b83f-4bae-ab3f-3be0443320eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:49.490261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5663d4dd-b83f-4bae-ab3f-3be0443320eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:49.491017 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5663d4dd-b83f-4bae-ab3f-3be0443320eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:49.491452 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5663d4dd-b83f-4bae-ab3f-3be0443320eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:49.491886 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5663d4dd-b83f-4bae-ab3f-3be0443320eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:49.648266 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5663d4dd-b83f-4bae-ab3f-3be0443320eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:49.656222 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5663d4dd-b83f-4bae-ab3f-3be0443320eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.181766 Aug 18 11:10:49.656800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 416/848] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:49 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:50.680168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6f2ce371-b49a-4aa8-9241-78cef7ee0f3e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:50.680787 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6f2ce371-b49a-4aa8-9241-78cef7ee0f3e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:50.691375 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6f2ce371-b49a-4aa8-9241-78cef7ee0f3e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:50.691862 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6f2ce371-b49a-4aa8-9241-78cef7ee0f3e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:50.692295 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6f2ce371-b49a-4aa8-9241-78cef7ee0f3e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:50.692997 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6f2ce371-b49a-4aa8-9241-78cef7ee0f3e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:50.693445 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6f2ce371-b49a-4aa8-9241-78cef7ee0f3e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:50.693894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6f2ce371-b49a-4aa8-9241-78cef7ee0f3e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:50.854322 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6f2ce371-b49a-4aa8-9241-78cef7ee0f3e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:50.863345 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6f2ce371-b49a-4aa8-9241-78cef7ee0f3e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.187256 Aug 18 11:10:50.863934 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 433/849] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:50 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:51.887507 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d83078bc-28a1-4771-a953-b2a5a4316921 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:51.889389 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d83078bc-28a1-4771-a953-b2a5a4316921 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:51.896386 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d83078bc-28a1-4771-a953-b2a5a4316921 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:51.896880 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d83078bc-28a1-4771-a953-b2a5a4316921 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:51.897319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d83078bc-28a1-4771-a953-b2a5a4316921 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:51.898060 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d83078bc-28a1-4771-a953-b2a5a4316921 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:51.898520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d83078bc-28a1-4771-a953-b2a5a4316921 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:51.898981 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d83078bc-28a1-4771-a953-b2a5a4316921 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:52.043322 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d83078bc-28a1-4771-a953-b2a5a4316921 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:52.051565 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d83078bc-28a1-4771-a953-b2a5a4316921 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.169780 Aug 18 11:10:52.052422 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 417/850] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:51 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:53.072339 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3e9459d1-48a6-49c8-a252-939f78354d87 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:53.072902 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3e9459d1-48a6-49c8-a252-939f78354d87 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:53.079517 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e9459d1-48a6-49c8-a252-939f78354d87 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:53.079995 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e9459d1-48a6-49c8-a252-939f78354d87 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:53.080425 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e9459d1-48a6-49c8-a252-939f78354d87 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:53.081105 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e9459d1-48a6-49c8-a252-939f78354d87 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:53.081571 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e9459d1-48a6-49c8-a252-939f78354d87 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:53.081991 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3e9459d1-48a6-49c8-a252-939f78354d87 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:53.218787 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3e9459d1-48a6-49c8-a252-939f78354d87 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:53.226389 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3e9459d1-48a6-49c8-a252-939f78354d87 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.158023 Aug 18 11:10:53.226979 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 434/851] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:53 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:53.926506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-382da639-e17d-4e74-9192-9baedb4fd3e2 req-4a4304c5-8177-41c4-a8d4-641546a26d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0a1d6b-a999-4c67-b558-fa17a12a486b", "tag": "490cedd8-1283-4951-bc9b-5dd41c51a56c"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:53.932545 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:53.935702 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=6 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:53.947400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-382da639-e17d-4e74-9192-9baedb4fd3e2 req-4a4304c5-8177-41c4-a8d4-641546a26d47 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:53.947882 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-382da639-e17d-4e74-9192-9baedb4fd3e2 req-4a4304c5-8177-41c4-a8d4-641546a26d47 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:53.948400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-382da639-e17d-4e74-9192-9baedb4fd3e2 req-4a4304c5-8177-41c4-a8d4-641546a26d47 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:53.963480 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-382da639-e17d-4e74-9192-9baedb4fd3e2 req-4a4304c5-8177-41c4-a8d4-641546a26d47 service nova] Creating event network-changed:490cedd8-1283-4951-bc9b-5dd41c51a56c for instance ef0a1d6b-a999-4c67-b558-fa17a12a486b on hv-cinder-82660 Aug 18 11:10:53.969980 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-382da639-e17d-4e74-9192-9baedb4fd3e2 req-4a4304c5-8177-41c4-a8d4-641546a26d47 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047357 Aug 18 11:10:53.971086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 418/852] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:10:54.249222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5247718a-ca16-46d1-a8c8-d94e82b58328 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:54.250252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5247718a-ca16-46d1-a8c8-d94e82b58328 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:54.252281 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=6 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:54.259997 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5247718a-ca16-46d1-a8c8-d94e82b58328 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:54.260582 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5247718a-ca16-46d1-a8c8-d94e82b58328 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:54.261357 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5247718a-ca16-46d1-a8c8-d94e82b58328 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:54.262879 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5247718a-ca16-46d1-a8c8-d94e82b58328 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:54.263421 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5247718a-ca16-46d1-a8c8-d94e82b58328 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:54.263930 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5247718a-ca16-46d1-a8c8-d94e82b58328 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:54.449729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5247718a-ca16-46d1-a8c8-d94e82b58328 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:54.459423 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5247718a-ca16-46d1-a8c8-d94e82b58328 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.215280 Aug 18 11:10:54.461642 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 435/853] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:54 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:55.484548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-77a594cc-af92-4607-8f40-d082363990c4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:55.485301 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-77a594cc-af92-4607-8f40-d082363990c4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:55.492718 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a594cc-af92-4607-8f40-d082363990c4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:55.493326 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a594cc-af92-4607-8f40-d082363990c4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:55.494071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a594cc-af92-4607-8f40-d082363990c4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:55.494850 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a594cc-af92-4607-8f40-d082363990c4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:55.495365 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a594cc-af92-4607-8f40-d082363990c4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:55.496098 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-77a594cc-af92-4607-8f40-d082363990c4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:55.752479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-77a594cc-af92-4607-8f40-d082363990c4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:55.760170 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-77a594cc-af92-4607-8f40-d082363990c4 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.282382 Aug 18 11:10:55.760731 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 419/854] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:55 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:56.781983 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-15f2df67-37b9-43cd-b99a-ba276204eb73 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:56.782592 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-15f2df67-37b9-43cd-b99a-ba276204eb73 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:56.789197 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-15f2df67-37b9-43cd-b99a-ba276204eb73 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:56.789726 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-15f2df67-37b9-43cd-b99a-ba276204eb73 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:56.790161 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-15f2df67-37b9-43cd-b99a-ba276204eb73 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:56.790852 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-15f2df67-37b9-43cd-b99a-ba276204eb73 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:56.791300 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-15f2df67-37b9-43cd-b99a-ba276204eb73 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:56.791793 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-15f2df67-37b9-43cd-b99a-ba276204eb73 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:56.935981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-15f2df67-37b9-43cd-b99a-ba276204eb73 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:56.943508 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-15f2df67-37b9-43cd-b99a-ba276204eb73 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.165356 Aug 18 11:10:56.944075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 436/855] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:56 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:57.964727 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6f26a7f4-6ef5-4d94-b016-881faaff8c15 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:57.965407 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6f26a7f4-6ef5-4d94-b016-881faaff8c15 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:57.971891 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6f26a7f4-6ef5-4d94-b016-881faaff8c15 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:57.972369 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6f26a7f4-6ef5-4d94-b016-881faaff8c15 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:57.972799 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6f26a7f4-6ef5-4d94-b016-881faaff8c15 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:57.973490 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6f26a7f4-6ef5-4d94-b016-881faaff8c15 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:57.973968 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6f26a7f4-6ef5-4d94-b016-881faaff8c15 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:57.974383 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6f26a7f4-6ef5-4d94-b016-881faaff8c15 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:57.977051 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=61 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:58.108589 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6f26a7f4-6ef5-4d94-b016-881faaff8c15 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:58.116148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6f26a7f4-6ef5-4d94-b016-881faaff8c15 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.155678 Aug 18 11:10:58.116711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 420/856] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:57 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:59.140720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a862d4a7-206b-4eef-881b-7a988070f533 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:10:59.141324 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a862d4a7-206b-4eef-881b-7a988070f533 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:10:59.147299 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a862d4a7-206b-4eef-881b-7a988070f533 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:59.147780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a862d4a7-206b-4eef-881b-7a988070f533 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:59.148213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a862d4a7-206b-4eef-881b-7a988070f533 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:59.148902 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a862d4a7-206b-4eef-881b-7a988070f533 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:59.149354 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a862d4a7-206b-4eef-881b-7a988070f533 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:59.149805 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a862d4a7-206b-4eef-881b-7a988070f533 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:59.281031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a862d4a7-206b-4eef-881b-7a988070f533 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:10:59.288597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a862d4a7-206b-4eef-881b-7a988070f533 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.154331 Aug 18 11:10:59.289173 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 437/857] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:10:59 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:59.819181 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-e78b3452-997b-4451-99a6-88d565909a1c req-f635fc42-fe0b-4e7a-9862-9e86c06b3d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0a1d6b-a999-4c67-b558-fa17a12a486b", "name": "network-vif-plugged", "status": "completed", "tag": "490cedd8-1283-4951-bc9b-5dd41c51a56c"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:10:59.830564 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e78b3452-997b-4451-99a6-88d565909a1c req-f635fc42-fe0b-4e7a-9862-9e86c06b3d91 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:10:59.831105 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e78b3452-997b-4451-99a6-88d565909a1c req-f635fc42-fe0b-4e7a-9862-9e86c06b3d91 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:10:59.831544 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-e78b3452-997b-4451-99a6-88d565909a1c req-f635fc42-fe0b-4e7a-9862-9e86c06b3d91 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:10:59.844214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-e78b3452-997b-4451-99a6-88d565909a1c req-f635fc42-fe0b-4e7a-9862-9e86c06b3d91 service nova] Creating event network-vif-plugged:490cedd8-1283-4951-bc9b-5dd41c51a56c for instance ef0a1d6b-a999-4c67-b558-fa17a12a486b on hv-cinder-82660 Aug 18 11:10:59.849257 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-e78b3452-997b-4451-99a6-88d565909a1c req-f635fc42-fe0b-4e7a-9862-9e86c06b3d91 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034125 Aug 18 11:10:59.849953 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 421/858] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:11:00.311052 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e3acedbb-aecf-4e52-a548-553d9763de77 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:00.311593 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e3acedbb-aecf-4e52-a548-553d9763de77 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:00.318289 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3acedbb-aecf-4e52-a548-553d9763de77 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:00.318791 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3acedbb-aecf-4e52-a548-553d9763de77 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:00.319234 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3acedbb-aecf-4e52-a548-553d9763de77 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:00.319954 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3acedbb-aecf-4e52-a548-553d9763de77 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:00.320413 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3acedbb-aecf-4e52-a548-553d9763de77 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:00.320843 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e3acedbb-aecf-4e52-a548-553d9763de77 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:00.453927 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e3acedbb-aecf-4e52-a548-553d9763de77 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:00.461297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e3acedbb-aecf-4e52-a548-553d9763de77 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1358 microversion: 2.1 time: 0.155481 Aug 18 11:11:00.461896 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 438/859] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:00 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:01.482948 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-bb12511c-1ebb-41df-8108-92905c19993b tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:01.483647 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-bb12511c-1ebb-41df-8108-92905c19993b tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:01.489864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bb12511c-1ebb-41df-8108-92905c19993b tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:01.490473 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bb12511c-1ebb-41df-8108-92905c19993b tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:01.490797 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bb12511c-1ebb-41df-8108-92905c19993b tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:01.491500 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bb12511c-1ebb-41df-8108-92905c19993b tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:01.491951 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bb12511c-1ebb-41df-8108-92905c19993b tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:01.492402 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bb12511c-1ebb-41df-8108-92905c19993b tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:01.627472 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bb12511c-1ebb-41df-8108-92905c19993b tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:01.635689 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-bb12511c-1ebb-41df-8108-92905c19993b tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1548 microversion: 2.1 time: 0.157288 Aug 18 11:11:01.636214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 422/860] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:01 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:01.656957 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7138e4ec-2347-4514-8c47-3bc10fec9494 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:01.657581 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7138e4ec-2347-4514-8c47-3bc10fec9494 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:01.664016 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7138e4ec-2347-4514-8c47-3bc10fec9494 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:01.664490 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7138e4ec-2347-4514-8c47-3bc10fec9494 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:01.664924 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7138e4ec-2347-4514-8c47-3bc10fec9494 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:01.665681 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7138e4ec-2347-4514-8c47-3bc10fec9494 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:01.666076 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7138e4ec-2347-4514-8c47-3bc10fec9494 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:01.666494 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7138e4ec-2347-4514-8c47-3bc10fec9494 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:01.797899 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7138e4ec-2347-4514-8c47-3bc10fec9494 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:01.805428 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7138e4ec-2347-4514-8c47-3bc10fec9494 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1548 microversion: 2.1 time: 0.152288 Aug 18 11:11:01.806026 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 439/861] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:01 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:01.826019 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:01.832269 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:01.833105 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Searching by: {'deleted': False, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2'} {{(pid=120801) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:11:01.839874 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:01.840357 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:01.840804 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:01.841551 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:01.841996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:01.842421 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:01.936370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.multi_cell_list [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:11:02.031425 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b3707938-df6e-4e8b-9bac-a7c00b4fea1c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209500 Aug 18 11:11:02.032009 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 423/862] 10.222.0.15 () {58 vars in 1125 bytes} [Thu Aug 18 11:11:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:11:02.044273 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3a347ae1-72d4-459f-9be9-5c1473f8f98d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:02.044892 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3a347ae1-72d4-459f-9be9-5c1473f8f98d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:02.051125 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a347ae1-72d4-459f-9be9-5c1473f8f98d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:02.051606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a347ae1-72d4-459f-9be9-5c1473f8f98d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:02.052041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a347ae1-72d4-459f-9be9-5c1473f8f98d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:02.052732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a347ae1-72d4-459f-9be9-5c1473f8f98d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:02.053186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a347ae1-72d4-459f-9be9-5c1473f8f98d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:02.053657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3a347ae1-72d4-459f-9be9-5c1473f8f98d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:02.188210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-3a347ae1-72d4-459f-9be9-5c1473f8f98d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:02.195596 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3a347ae1-72d4-459f-9be9-5c1473f8f98d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1548 microversion: 2.1 time: 0.156193 Aug 18 11:11:02.196156 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 440/863] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:02 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:03.756289 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-23bf7087-4891-43ee-9e70-87fad624934c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "905b3036-cf1c-4598-ae3f-c81d516ba163"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:03.758814 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-23bf7087-4891-43ee-9e70-87fad624934c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:03.761228 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:03.767150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-23bf7087-4891-43ee-9e70-87fad624934c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:03.767641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-23bf7087-4891-43ee-9e70-87fad624934c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:03.768083 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-23bf7087-4891-43ee-9e70-87fad624934c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:03.768846 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-23bf7087-4891-43ee-9e70-87fad624934c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:03.769251 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-23bf7087-4891-43ee-9e70-87fad624934c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:03.769714 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-23bf7087-4891-43ee-9e70-87fad624934c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:04.015677 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-23bf7087-4891-43ee-9e70-87fad624934c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "POST /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263760 Aug 18 11:11:04.016566 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 424/864] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:11:03 2022] POST /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:11:08.950080 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7fbabb7f-fb98-4596-bc95-ef1ce3eb5ba1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:08.952330 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7fbabb7f-fb98-4596-bc95-ef1ce3eb5ba1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:08.954844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:08.960197 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7fbabb7f-fb98-4596-bc95-ef1ce3eb5ba1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:08.960681 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7fbabb7f-fb98-4596-bc95-ef1ce3eb5ba1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:08.961116 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7fbabb7f-fb98-4596-bc95-ef1ce3eb5ba1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:08.961966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7fbabb7f-fb98-4596-bc95-ef1ce3eb5ba1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:08.962426 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7fbabb7f-fb98-4596-bc95-ef1ce3eb5ba1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:08.962853 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7fbabb7f-fb98-4596-bc95-ef1ce3eb5ba1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:08.993988 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7fbabb7f-fb98-4596-bc95-ef1ce3eb5ba1 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048683 Aug 18 11:11:08.994541 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 441/865] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:11:08 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:11:09.059362 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-448c7952-fc51-47da-a72a-7175b7a5b54f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:09.059942 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-448c7952-fc51-47da-a72a-7175b7a5b54f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:09.066147 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-448c7952-fc51-47da-a72a-7175b7a5b54f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:09.066625 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-448c7952-fc51-47da-a72a-7175b7a5b54f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:09.067056 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-448c7952-fc51-47da-a72a-7175b7a5b54f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:09.067744 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-448c7952-fc51-47da-a72a-7175b7a5b54f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:09.068192 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-448c7952-fc51-47da-a72a-7175b7a5b54f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:09.068615 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-448c7952-fc51-47da-a72a-7175b7a5b54f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:09.093317 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-448c7952-fc51-47da-a72a-7175b7a5b54f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:11:09.177462 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-448c7952-fc51-47da-a72a-7175b7a5b54f tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 204 len: 0 microversion: 2.1 time: 0.122945 Aug 18 11:11:09.178000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 425/866] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:11:09 2022] DELETE /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:11:09.187649 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c7bbf350-3743-4b99-8eae-c562b57be796 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:09.188262 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c7bbf350-3743-4b99-8eae-c562b57be796 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:09.194247 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c7bbf350-3743-4b99-8eae-c562b57be796 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:09.194732 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c7bbf350-3743-4b99-8eae-c562b57be796 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:09.195158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c7bbf350-3743-4b99-8eae-c562b57be796 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:09.195841 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c7bbf350-3743-4b99-8eae-c562b57be796 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:09.196298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c7bbf350-3743-4b99-8eae-c562b57be796 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:09.196716 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c7bbf350-3743-4b99-8eae-c562b57be796 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:09.330058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c7bbf350-3743-4b99-8eae-c562b57be796 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:09.338213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c7bbf350-3743-4b99-8eae-c562b57be796 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1675 microversion: 2.1 time: 0.155464 Aug 18 11:11:09.338876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 442/867] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:09 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:11:10.361716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4cdbf86a-5b5a-4355-843f-5e93ac6a7cf0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:10.362429 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4cdbf86a-5b5a-4355-843f-5e93ac6a7cf0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:10.368866 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdbf86a-5b5a-4355-843f-5e93ac6a7cf0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:10.369333 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdbf86a-5b5a-4355-843f-5e93ac6a7cf0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:10.369782 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdbf86a-5b5a-4355-843f-5e93ac6a7cf0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:10.370993 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdbf86a-5b5a-4355-843f-5e93ac6a7cf0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:10.372192 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdbf86a-5b5a-4355-843f-5e93ac6a7cf0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:10.372632 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4cdbf86a-5b5a-4355-843f-5e93ac6a7cf0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:10.506445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4cdbf86a-5b5a-4355-843f-5e93ac6a7cf0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:10.515283 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4cdbf86a-5b5a-4355-843f-5e93ac6a7cf0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1675 microversion: 2.1 time: 0.157817 Aug 18 11:11:10.515856 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 426/868] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:10 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:11.537767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ee0b9cc3-4955-4a87-973c-7ceb8bba0875 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:11.538380 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ee0b9cc3-4955-4a87-973c-7ceb8bba0875 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:11.545124 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee0b9cc3-4955-4a87-973c-7ceb8bba0875 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:11.545641 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee0b9cc3-4955-4a87-973c-7ceb8bba0875 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:11.546324 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee0b9cc3-4955-4a87-973c-7ceb8bba0875 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:11.547029 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee0b9cc3-4955-4a87-973c-7ceb8bba0875 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:11.547484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee0b9cc3-4955-4a87-973c-7ceb8bba0875 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:11.547911 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ee0b9cc3-4955-4a87-973c-7ceb8bba0875 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:11.691988 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ee0b9cc3-4955-4a87-973c-7ceb8bba0875 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:11.699430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ee0b9cc3-4955-4a87-973c-7ceb8bba0875 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1675 microversion: 2.1 time: 0.165634 Aug 18 11:11:11.700490 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 443/869] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:11 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:12.589020 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-a94f94d9-3812-4474-94a5-ea78ce515425 req-0d3796a1-7cb5-498b-a690-941a5d16a095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4584500a-8d03-4227-ac47-c7ea8b80d2ce", "name": "network-vif-deleted", "tag": "b0d5a80e-61c6-406b-b831-5f20d3e9500b"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:12.600255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:12.609301 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-a94f94d9-3812-4474-94a5-ea78ce515425 req-0d3796a1-7cb5-498b-a690-941a5d16a095 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:12.610546 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-a94f94d9-3812-4474-94a5-ea78ce515425 req-0d3796a1-7cb5-498b-a690-941a5d16a095 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:12.611480 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-a94f94d9-3812-4474-94a5-ea78ce515425 req-0d3796a1-7cb5-498b-a690-941a5d16a095 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:12.641538 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-a94f94d9-3812-4474-94a5-ea78ce515425 req-0d3796a1-7cb5-498b-a690-941a5d16a095 service nova] Creating event network-vif-deleted:b0d5a80e-61c6-406b-b831-5f20d3e9500b for instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce on hv-cinder-82660 Aug 18 11:11:12.648033 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-a94f94d9-3812-4474-94a5-ea78ce515425 req-0d3796a1-7cb5-498b-a690-941a5d16a095 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063208 Aug 18 11:11:12.655421 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 427/870] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:11:12.692899 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b96151af-809c-459a-8145-3c6aa44b4b34 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:12.693681 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b96151af-809c-459a-8145-3c6aa44b4b34 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:12.703023 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b96151af-809c-459a-8145-3c6aa44b4b34 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:12.704071 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b96151af-809c-459a-8145-3c6aa44b4b34 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:12.705461 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b96151af-809c-459a-8145-3c6aa44b4b34 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:12.706692 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b96151af-809c-459a-8145-3c6aa44b4b34 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:12.707388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b96151af-809c-459a-8145-3c6aa44b4b34 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:12.708148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b96151af-809c-459a-8145-3c6aa44b4b34 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:12.723010 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:12.723778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:12.735064 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:12.735599 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:12.736045 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:12.736751 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:12.737201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:12.737648 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:12.783501 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:12.784022 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:12.784633 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:12.785263 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lazy-loading 'fault' on Instance uuid 4584500a-8d03-4227-ac47-c7ea8b80d2ce {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:11:12.836404 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:12.846810 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c9f9a351-280e-4821-b8a8-7d282d11851e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 200 len: 1328 microversion: 2.1 time: 0.129189 Aug 18 11:11:12.847898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 428/871] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:12 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:11:12.873844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b96151af-809c-459a-8145-3c6aa44b4b34 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:12.883231 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b96151af-809c-459a-8145-3c6aa44b4b34 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1594 microversion: 2.1 time: 0.193580 Aug 18 11:11:12.883231 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 444/872] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:12 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1594 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:13.868664 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:13.869273 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:13.875478 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:13.875952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:13.876411 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:13.877113 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:13.877602 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:13.878033 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:13.891827 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] HTTP exception thrown: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Request method failure captured: Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce HTTP/1.1 Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_h2ZlHFg0ZNbiYtbz_Dz90irfMjnd7sCsLGgtFUHuF0d-Cnpuk3h6uG08wfaZuQb4VPqgA5aVM5faXO_rlmv0GoNc0_3pJ96PnAEh0OcpIo4ptTrSWZ1w_umYr3a-mLbhYBegEYwPZELiGKpCVS3YjnqPYyh46Eqnjgq5MUMeKfN12U Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:11:13.893457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c2dd094c20324a7e8bfe6f3ea11dce38", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c2dd094c20324a7e8bfe6f3ea11dce38"}]}] Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 932e75ccffec4118b9de434cc59564f7 Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:11:13.894933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '4584500a-8d03-4227-ac47-c7ea8b80d2ce'} Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:11:13.895773 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:11:13.897166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:11:13.898585 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Returning 404 to user: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:11:13.898585 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-59179444-237e-4853-91f5-ec2218cc584e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 404 len: 111 microversion: 2.1 time: 0.030571 Aug 18 11:11:13.898585 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 429/873] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:13 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:11:13.904517 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c64a4e4a-1d65-4e96-9570-1b5fc50e4812 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '.version_select at 0x7f7ec8996040>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:13.925684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c64a4e4a-1d65-4e96-9570-1b5fc50e4812 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401218901" status: 202 len: 0 microversion: 2.1 time: 0.025541 Aug 18 11:11:13.926484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 445/874] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Aug 18 11:11:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401218901 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:11:14.580716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-21debafd-8d26-456a-bb15-40eb898953e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'create', calling method: .version_select at 0x7f7ec8ac3ca0>, body: {"keypair": {"name": "tempest-keypair-813108211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEUFXjasE4tVkJ/hW6CGZWfVozHy48JQiryb6poeZSZ5skhm3f394GMYNZq/krRquY1c3L/qbrZeCuXYpQRDu0AyM4fpxGTSrGv5PKRdhQz/tRYPh2XyfzkzApM50V7ew=="}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:14.596738 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-21debafd-8d26-456a-bb15-40eb898953e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Getting quotas for project c2dd094c20324a7e8bfe6f3ea11dce38. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:11:14.600653 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-21debafd-8d26-456a-bb15-40eb898953e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Getting quotas for user 932e75ccffec4118b9de434cc59564f7 and project c2dd094c20324a7e8bfe6f3ea11dce38. Resources: {'key_pairs'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:11:14.612429 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR oslo.messaging._drivers.impl_rabbit [None req-21debafd-8d26-456a-bb15-40eb898953e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [281d5a41-c1a6-406f-a043-f70f3760beed] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 11:11:14.943261 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-f56e6d25-d70a-41c9-9f12-452205c7ab43 req-0f67c486-31ee-4bd2-b1da-871ba591dfec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0a1d6b-a999-4c67-b558-fa17a12a486b", "tag": "490cedd8-1283-4951-bc9b-5dd41c51a56c"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:14.955648 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-f56e6d25-d70a-41c9-9f12-452205c7ab43 req-0f67c486-31ee-4bd2-b1da-871ba591dfec service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:14.956137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-f56e6d25-d70a-41c9-9f12-452205c7ab43 req-0f67c486-31ee-4bd2-b1da-871ba591dfec service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:14.956576 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-f56e6d25-d70a-41c9-9f12-452205c7ab43 req-0f67c486-31ee-4bd2-b1da-871ba591dfec service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:14.968466 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-f56e6d25-d70a-41c9-9f12-452205c7ab43 req-0f67c486-31ee-4bd2-b1da-871ba591dfec service nova] Creating event network-changed:490cedd8-1283-4951-bc9b-5dd41c51a56c for instance ef0a1d6b-a999-4c67-b558-fa17a12a486b on hv-cinder-82660 Aug 18 11:11:14.974061 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-f56e6d25-d70a-41c9-9f12-452205c7ab43 req-0f67c486-31ee-4bd2-b1da-871ba591dfec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228594 Aug 18 11:11:14.975219 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 446/875] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:11:15.620234 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO oslo.messaging._drivers.impl_rabbit [None req-21debafd-8d26-456a-bb15-40eb898953e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [281d5a41-c1a6-406f-a043-f70f3760beed] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 51030. Aug 18 11:11:15.637988 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-21debafd-8d26-456a-bb15-40eb898953e0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.061077 Aug 18 11:11:15.639718 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 430/876] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Aug 18 11:11:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:11:15.937929 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c09a5851-fe80-4863-87dc-5b4f559148b0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-459029098"}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:15.939097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c09a5851-fe80-4863-87dc-5b4f559148b0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:15.946178 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c09a5851-fe80-4863-87dc-5b4f559148b0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:15.946741 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c09a5851-fe80-4863-87dc-5b4f559148b0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:15.947098 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c09a5851-fe80-4863-87dc-5b4f559148b0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:15.947818 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c09a5851-fe80-4863-87dc-5b4f559148b0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:15.948303 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c09a5851-fe80-4863-87dc-5b4f559148b0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:15.948729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c09a5851-fe80-4863-87dc-5b4f559148b0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:15.966854 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=89 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:16.096003 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.network.security_group_api [None req-c09a5851-fe80-4863-87dc-5b4f559148b0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Adding security group 079a9872-a5fd-4e20-8ad4-d8148111c98e to port 490cedd8-1283-4951-bc9b-5dd41c51a56c Aug 18 11:11:16.440647 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c09a5851-fe80-4863-87dc-5b4f559148b0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "POST /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/action" status: 202 len: 0 microversion: 2.1 time: 0.503294 Aug 18 11:11:16.445057 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 447/877] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:11:15 2022] POST /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:11:16.451208 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d6b7fdeb-1566-44fa-9031-1245743cd1d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:16.453947 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d6b7fdeb-1566-44fa-9031-1245743cd1d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:16.473605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d6b7fdeb-1566-44fa-9031-1245743cd1d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:16.474504 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d6b7fdeb-1566-44fa-9031-1245743cd1d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:16.474950 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d6b7fdeb-1566-44fa-9031-1245743cd1d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:16.475667 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d6b7fdeb-1566-44fa-9031-1245743cd1d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:16.476125 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d6b7fdeb-1566-44fa-9031-1245743cd1d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:16.476552 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d6b7fdeb-1566-44fa-9031-1245743cd1d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:16.759484 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d6b7fdeb-1566-44fa-9031-1245743cd1d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:16.768685 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d6b7fdeb-1566-44fa-9031-1245743cd1d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1758 microversion: 2.1 time: 0.322464 Aug 18 11:11:16.785342 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 431/878] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:16 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1758 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:16.844191 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:11:16.844378 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Thu Aug 18 11:11:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:11:16.991993 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-dfcca843-5491-4712-9ec0-a89e3ba1d61d req-5660159a-9608-4c59-90e2-40ed0d99b660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0a1d6b-a999-4c67-b558-fa17a12a486b", "tag": "490cedd8-1283-4951-bc9b-5dd41c51a56c"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:17.005038 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-dfcca843-5491-4712-9ec0-a89e3ba1d61d req-5660159a-9608-4c59-90e2-40ed0d99b660 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:17.005813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-dfcca843-5491-4712-9ec0-a89e3ba1d61d req-5660159a-9608-4c59-90e2-40ed0d99b660 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:17.006621 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-dfcca843-5491-4712-9ec0-a89e3ba1d61d req-5660159a-9608-4c59-90e2-40ed0d99b660 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:17.018879 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-dfcca843-5491-4712-9ec0-a89e3ba1d61d req-5660159a-9608-4c59-90e2-40ed0d99b660 service nova] Creating event network-changed:490cedd8-1283-4951-bc9b-5dd41c51a56c for instance ef0a1d6b-a999-4c67-b558-fa17a12a486b on hv-cinder-82660 Aug 18 11:11:17.024849 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-dfcca843-5491-4712-9ec0-a89e3ba1d61d req-5660159a-9608-4c59-90e2-40ed0d99b660 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037096 Aug 18 11:11:17.031747 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 448/879] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:11:17.504953 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-545841230", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "551dffce-6b62-4983-a0bb-9eee38dc5368"}], "security_groups": [{"name": "tempest-securitygroup--1018432790"}], "key_name": "tempest-keypair-813108211", "user_data": "}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:17.647490 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] validate_networks() for [('551dffce-6b62-4983-a0bb-9eee38dc5368', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:11:18.183939 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:11:18.185435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:11:18.185964 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:11:18.186368 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:11:18.186797 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:11:18.195650 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:18.196140 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:18.196582 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:18.197399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:18.197846 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:18.198223 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:18.216159 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Getting quotas for project c2dd094c20324a7e8bfe6f3ea11dce38. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:11:18.220419 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Getting quotas for user 932e75ccffec4118b9de434cc59564f7 and project c2dd094c20324a7e8bfe6f3ea11dce38. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:11:18.232402 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:11:18.234722 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:11:18.280475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-dea5889d-d474-46ab-bd1d-297bbefcfb98 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779790 Aug 18 11:11:18.281305 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 432/880] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:11:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:11:18.292462 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c8ca25fb-7778-49cf-a191-9c045f4243a0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:18.293161 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c8ca25fb-7778-49cf-a191-9c045f4243a0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:18.350127 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c8ca25fb-7778-49cf-a191-9c045f4243a0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:18.358725 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c8ca25fb-7778-49cf-a191-9c045f4243a0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1236 microversion: 2.1 time: 0.070481 Aug 18 11:11:18.359936 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 449/881] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:18 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:19.381678 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-76b24a7a-8f0e-480c-aecb-bc6673bb97b5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:19.382350 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-76b24a7a-8f0e-480c-aecb-bc6673bb97b5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:19.390107 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-76b24a7a-8f0e-480c-aecb-bc6673bb97b5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:19.390873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-76b24a7a-8f0e-480c-aecb-bc6673bb97b5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:19.391309 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-76b24a7a-8f0e-480c-aecb-bc6673bb97b5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:19.392158 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-76b24a7a-8f0e-480c-aecb-bc6673bb97b5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:19.392786 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-76b24a7a-8f0e-480c-aecb-bc6673bb97b5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:19.393290 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-76b24a7a-8f0e-480c-aecb-bc6673bb97b5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:19.491530 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-76b24a7a-8f0e-480c-aecb-bc6673bb97b5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:19.499736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-76b24a7a-8f0e-480c-aecb-bc6673bb97b5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1294 microversion: 2.1 time: 0.123402 Aug 18 11:11:19.500319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 433/882] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:19 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1294 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:20.520334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0142af4d-65ad-46a0-a5db-76729abd786c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:20.520974 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0142af4d-65ad-46a0-a5db-76729abd786c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:20.528988 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0142af4d-65ad-46a0-a5db-76729abd786c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:20.529496 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0142af4d-65ad-46a0-a5db-76729abd786c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:20.529961 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0142af4d-65ad-46a0-a5db-76729abd786c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:20.530670 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0142af4d-65ad-46a0-a5db-76729abd786c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:20.531125 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0142af4d-65ad-46a0-a5db-76729abd786c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:20.531554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0142af4d-65ad-46a0-a5db-76729abd786c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:20.582980 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-5ca5d1ab-c3a2-4a36-8089-f0d48b39d28a req-4433eb57-3f7b-4ae1-bf6b-e30ebc3cb862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829cc03a-13f5-48fd-9069-a9f21d4b9758", "tag": "de1962c2-9b10-426f-8ede-e567e6c7edae"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:20.598720 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-5ca5d1ab-c3a2-4a36-8089-f0d48b39d28a req-4433eb57-3f7b-4ae1-bf6b-e30ebc3cb862 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:20.599357 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-5ca5d1ab-c3a2-4a36-8089-f0d48b39d28a req-4433eb57-3f7b-4ae1-bf6b-e30ebc3cb862 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:20.599890 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-5ca5d1ab-c3a2-4a36-8089-f0d48b39d28a req-4433eb57-3f7b-4ae1-bf6b-e30ebc3cb862 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:20.615245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-5ca5d1ab-c3a2-4a36-8089-f0d48b39d28a req-4433eb57-3f7b-4ae1-bf6b-e30ebc3cb862 service nova] Creating event network-changed:de1962c2-9b10-426f-8ede-e567e6c7edae for instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 on hv-cinder-82660 Aug 18 11:11:20.621289 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-5ca5d1ab-c3a2-4a36-8089-f0d48b39d28a req-4433eb57-3f7b-4ae1-bf6b-e30ebc3cb862 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042034 Aug 18 11:11:20.623352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 434/883] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:11:20.681108 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-0142af4d-65ad-46a0-a5db-76729abd786c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:20.689447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0142af4d-65ad-46a0-a5db-76729abd786c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1362 microversion: 2.1 time: 0.173016 Aug 18 11:11:20.690038 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 450/884] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:20 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:21.711485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-678c4cb1-49a5-4897-a7c0-9fb68e497a5c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:21.712197 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-678c4cb1-49a5-4897-a7c0-9fb68e497a5c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:21.719392 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-678c4cb1-49a5-4897-a7c0-9fb68e497a5c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:21.719877 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-678c4cb1-49a5-4897-a7c0-9fb68e497a5c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:21.720333 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-678c4cb1-49a5-4897-a7c0-9fb68e497a5c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:21.721026 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-678c4cb1-49a5-4897-a7c0-9fb68e497a5c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:21.721457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-678c4cb1-49a5-4897-a7c0-9fb68e497a5c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:21.721904 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-678c4cb1-49a5-4897-a7c0-9fb68e497a5c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:21.940689 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-678c4cb1-49a5-4897-a7c0-9fb68e497a5c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:21.948137 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-678c4cb1-49a5-4897-a7c0-9fb68e497a5c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1362 microversion: 2.1 time: 0.241517 Aug 18 11:11:21.948706 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 435/885] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:21 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:22.969824 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-21b2bbe8-a483-436b-adae-93940b1239bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:22.970385 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-21b2bbe8-a483-436b-adae-93940b1239bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:22.976975 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21b2bbe8-a483-436b-adae-93940b1239bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:22.977460 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21b2bbe8-a483-436b-adae-93940b1239bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:22.978000 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21b2bbe8-a483-436b-adae-93940b1239bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:22.978698 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21b2bbe8-a483-436b-adae-93940b1239bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:22.979157 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21b2bbe8-a483-436b-adae-93940b1239bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:22.979587 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-21b2bbe8-a483-436b-adae-93940b1239bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:23.115018 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-21b2bbe8-a483-436b-adae-93940b1239bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:23.123030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-21b2bbe8-a483-436b-adae-93940b1239bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1362 microversion: 2.1 time: 0.157462 Aug 18 11:11:23.123595 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 451/886] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:22 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:24.144240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d8ce9da2-0995-4153-b621-53ab003a4da0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:24.144882 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d8ce9da2-0995-4153-b621-53ab003a4da0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:24.151423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8ce9da2-0995-4153-b621-53ab003a4da0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:24.151905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8ce9da2-0995-4153-b621-53ab003a4da0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:24.152343 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8ce9da2-0995-4153-b621-53ab003a4da0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:24.153045 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8ce9da2-0995-4153-b621-53ab003a4da0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:24.153496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8ce9da2-0995-4153-b621-53ab003a4da0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:24.153945 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d8ce9da2-0995-4153-b621-53ab003a4da0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:24.291911 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d8ce9da2-0995-4153-b621-53ab003a4da0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:24.300435 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d8ce9da2-0995-4153-b621-53ab003a4da0 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1362 microversion: 2.1 time: 0.159989 Aug 18 11:11:24.301228 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 436/887] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:24 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:25.322481 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-05d7a94b-66e5-40f8-bdaf-71ee5546f3da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:25.323089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-05d7a94b-66e5-40f8-bdaf-71ee5546f3da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:25.330135 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d7a94b-66e5-40f8-bdaf-71ee5546f3da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:25.330621 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d7a94b-66e5-40f8-bdaf-71ee5546f3da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:25.331055 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d7a94b-66e5-40f8-bdaf-71ee5546f3da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:25.331741 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d7a94b-66e5-40f8-bdaf-71ee5546f3da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:25.332202 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d7a94b-66e5-40f8-bdaf-71ee5546f3da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:25.332623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-05d7a94b-66e5-40f8-bdaf-71ee5546f3da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:25.466730 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-05d7a94b-66e5-40f8-bdaf-71ee5546f3da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:25.474178 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-05d7a94b-66e5-40f8-bdaf-71ee5546f3da tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1362 microversion: 2.1 time: 0.155624 Aug 18 11:11:25.474743 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 452/888] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:25 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:25.955301 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-8142b806-47ba-4918-9bb5-8811b5da6aa7 req-f4c237f4-5843-4de9-ab37-4201a1c8ef41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829cc03a-13f5-48fd-9069-a9f21d4b9758", "name": "network-vif-plugged", "status": "completed", "tag": "de1962c2-9b10-426f-8ede-e567e6c7edae"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:25.965484 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-8142b806-47ba-4918-9bb5-8811b5da6aa7 req-f4c237f4-5843-4de9-ab37-4201a1c8ef41 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:25.966248 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-8142b806-47ba-4918-9bb5-8811b5da6aa7 req-f4c237f4-5843-4de9-ab37-4201a1c8ef41 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:25.966539 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-8142b806-47ba-4918-9bb5-8811b5da6aa7 req-f4c237f4-5843-4de9-ab37-4201a1c8ef41 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:25.978789 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-8142b806-47ba-4918-9bb5-8811b5da6aa7 req-f4c237f4-5843-4de9-ab37-4201a1c8ef41 service nova] Creating event network-vif-plugged:de1962c2-9b10-426f-8ede-e567e6c7edae for instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 on hv-cinder-82660 Aug 18 11:11:25.985223 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-8142b806-47ba-4918-9bb5-8811b5da6aa7 req-f4c237f4-5843-4de9-ab37-4201a1c8ef41 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033659 Aug 18 11:11:25.985865 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 437/889] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:11:26.494877 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9d38e5ae-44fd-4676-8675-eed5939c6c0c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:26.495512 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9d38e5ae-44fd-4676-8675-eed5939c6c0c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:26.502041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d38e5ae-44fd-4676-8675-eed5939c6c0c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:26.502501 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d38e5ae-44fd-4676-8675-eed5939c6c0c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:26.502934 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d38e5ae-44fd-4676-8675-eed5939c6c0c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:26.503669 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d38e5ae-44fd-4676-8675-eed5939c6c0c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:26.504071 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d38e5ae-44fd-4676-8675-eed5939c6c0c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:26.504493 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9d38e5ae-44fd-4676-8675-eed5939c6c0c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:26.639180 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9d38e5ae-44fd-4676-8675-eed5939c6c0c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:26.646655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9d38e5ae-44fd-4676-8675-eed5939c6c0c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1362 microversion: 2.1 time: 0.155605 Aug 18 11:11:26.647213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 453/890] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:26 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:27.669735 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-efdcc2de-7bb2-421e-a84c-53460e528509 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:27.670544 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-efdcc2de-7bb2-421e-a84c-53460e528509 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:27.676861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efdcc2de-7bb2-421e-a84c-53460e528509 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:27.677354 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efdcc2de-7bb2-421e-a84c-53460e528509 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:27.677811 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efdcc2de-7bb2-421e-a84c-53460e528509 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:27.678506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efdcc2de-7bb2-421e-a84c-53460e528509 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:27.678952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efdcc2de-7bb2-421e-a84c-53460e528509 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:27.679379 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efdcc2de-7bb2-421e-a84c-53460e528509 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:27.682131 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:27.825936 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-efdcc2de-7bb2-421e-a84c-53460e528509 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:27.834776 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-efdcc2de-7bb2-421e-a84c-53460e528509 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1362 microversion: 2.1 time: 0.170337 Aug 18 11:11:27.835354 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 438/891] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:27 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:28.856915 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4a503d3d-7faf-4775-92ca-c9b5c2013415 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:28.857550 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4a503d3d-7faf-4775-92ca-c9b5c2013415 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:28.859553 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:28.865297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a503d3d-7faf-4775-92ca-c9b5c2013415 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:28.865809 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a503d3d-7faf-4775-92ca-c9b5c2013415 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:28.866255 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a503d3d-7faf-4775-92ca-c9b5c2013415 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:28.866946 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a503d3d-7faf-4775-92ca-c9b5c2013415 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:28.867400 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a503d3d-7faf-4775-92ca-c9b5c2013415 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:28.867821 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4a503d3d-7faf-4775-92ca-c9b5c2013415 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:29.003997 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4a503d3d-7faf-4775-92ca-c9b5c2013415 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:29.011554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4a503d3d-7faf-4775-92ca-c9b5c2013415 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1548 microversion: 2.1 time: 0.159229 Aug 18 11:11:29.012341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 454/892] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:28 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:29.033084 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c8b711a6-3a8f-4bca-aaa9-3ba7b370aa10 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:29.033641 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c8b711a6-3a8f-4bca-aaa9-3ba7b370aa10 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:29.035474 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:29.036154 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=10 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:29.042644 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c8b711a6-3a8f-4bca-aaa9-3ba7b370aa10 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:29.043073 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c8b711a6-3a8f-4bca-aaa9-3ba7b370aa10 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:29.044682 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c8b711a6-3a8f-4bca-aaa9-3ba7b370aa10 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:29.045396 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c8b711a6-3a8f-4bca-aaa9-3ba7b370aa10 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:29.045879 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c8b711a6-3a8f-4bca-aaa9-3ba7b370aa10 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:29.046314 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c8b711a6-3a8f-4bca-aaa9-3ba7b370aa10 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:29.125339 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c8b711a6-3a8f-4bca-aaa9-3ba7b370aa10 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096033 Aug 18 11:11:29.125969 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 439/893] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Aug 18 11:11:29 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:11:30.369954 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-0832c049-dfac-4977-ad4b-3caaf4146079 req-76890968-88fb-4fc9-8054-659e28bf1d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829cc03a-13f5-48fd-9069-a9f21d4b9758", "tag": "de1962c2-9b10-426f-8ede-e567e6c7edae"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:30.382052 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0832c049-dfac-4977-ad4b-3caaf4146079 req-76890968-88fb-4fc9-8054-659e28bf1d9a service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:30.382731 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0832c049-dfac-4977-ad4b-3caaf4146079 req-76890968-88fb-4fc9-8054-659e28bf1d9a service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:30.382945 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-0832c049-dfac-4977-ad4b-3caaf4146079 req-76890968-88fb-4fc9-8054-659e28bf1d9a service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:30.396288 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-0832c049-dfac-4977-ad4b-3caaf4146079 req-76890968-88fb-4fc9-8054-659e28bf1d9a service nova] Creating event network-changed:de1962c2-9b10-426f-8ede-e567e6c7edae for instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 on hv-cinder-82660 Aug 18 11:11:30.402172 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-0832c049-dfac-4977-ad4b-3caaf4146079 req-76890968-88fb-4fc9-8054-659e28bf1d9a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035662 Aug 18 11:11:30.403903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 455/894] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:11:39.363119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c92ef5ae-9bbe-4f45-9237-102ad38580bb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:11:39.365231 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c92ef5ae-9bbe-4f45-9237-102ad38580bb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:39.367697 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:39.368443 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=9 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:39.375678 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c92ef5ae-9bbe-4f45-9237-102ad38580bb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:39.376165 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c92ef5ae-9bbe-4f45-9237-102ad38580bb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:39.376627 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c92ef5ae-9bbe-4f45-9237-102ad38580bb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:39.377324 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c92ef5ae-9bbe-4f45-9237-102ad38580bb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:39.377812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c92ef5ae-9bbe-4f45-9237-102ad38580bb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:39.378237 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c92ef5ae-9bbe-4f45-9237-102ad38580bb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:39.451741 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c92ef5ae-9bbe-4f45-9237-102ad38580bb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "POST /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/action" status: 202 len: 0 microversion: 2.1 time: 0.092520 Aug 18 11:11:39.452443 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 440/895] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:11:39 2022] POST /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:11:39.463234 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bea335e7-0b95-47e5-b0b3-0019a24f1dce tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:39.464128 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bea335e7-0b95-47e5-b0b3-0019a24f1dce tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:39.467410 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:39.473274 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bea335e7-0b95-47e5-b0b3-0019a24f1dce tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:39.474213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bea335e7-0b95-47e5-b0b3-0019a24f1dce tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:39.474213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bea335e7-0b95-47e5-b0b3-0019a24f1dce tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:39.474955 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bea335e7-0b95-47e5-b0b3-0019a24f1dce tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:39.475417 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bea335e7-0b95-47e5-b0b3-0019a24f1dce tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:39.475845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bea335e7-0b95-47e5-b0b3-0019a24f1dce tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:39.630200 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bea335e7-0b95-47e5-b0b3-0019a24f1dce tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:39.638796 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bea335e7-0b95-47e5-b0b3-0019a24f1dce tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1750 microversion: 2.1 time: 0.179929 Aug 18 11:11:39.639371 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 456/896] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:39 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:40.662534 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2018330e-4773-475e-8f84-03f0fcebb33e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:40.663221 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2018330e-4773-475e-8f84-03f0fcebb33e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:40.670167 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2018330e-4773-475e-8f84-03f0fcebb33e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:40.670646 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2018330e-4773-475e-8f84-03f0fcebb33e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:40.671078 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2018330e-4773-475e-8f84-03f0fcebb33e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:40.672024 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2018330e-4773-475e-8f84-03f0fcebb33e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:40.672474 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2018330e-4773-475e-8f84-03f0fcebb33e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:40.672896 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2018330e-4773-475e-8f84-03f0fcebb33e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:40.821830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2018330e-4773-475e-8f84-03f0fcebb33e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:40.830235 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2018330e-4773-475e-8f84-03f0fcebb33e tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1755 microversion: 2.1 time: 0.172323 Aug 18 11:11:40.830832 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 441/897] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:40 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:41.851746 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-325ba650-c92a-42e2-b4dd-6c8d0aa96e26 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:41.852341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-325ba650-c92a-42e2-b4dd-6c8d0aa96e26 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:41.858926 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-325ba650-c92a-42e2-b4dd-6c8d0aa96e26 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:41.859410 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-325ba650-c92a-42e2-b4dd-6c8d0aa96e26 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:41.859845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-325ba650-c92a-42e2-b4dd-6c8d0aa96e26 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:41.860531 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-325ba650-c92a-42e2-b4dd-6c8d0aa96e26 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:41.860988 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-325ba650-c92a-42e2-b4dd-6c8d0aa96e26 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:41.861411 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-325ba650-c92a-42e2-b4dd-6c8d0aa96e26 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:42.010868 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-325ba650-c92a-42e2-b4dd-6c8d0aa96e26 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:42.023642 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-325ba650-c92a-42e2-b4dd-6c8d0aa96e26 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1755 microversion: 2.1 time: 0.175669 Aug 18 11:11:42.024230 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 457/898] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:41 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:43.045709 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-616da45c-85ce-487f-a561-37ea3d287661 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:43.046345 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-616da45c-85ce-487f-a561-37ea3d287661 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:43.053013 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-616da45c-85ce-487f-a561-37ea3d287661 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:43.053498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-616da45c-85ce-487f-a561-37ea3d287661 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:43.053960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-616da45c-85ce-487f-a561-37ea3d287661 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:43.054647 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-616da45c-85ce-487f-a561-37ea3d287661 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:43.055098 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-616da45c-85ce-487f-a561-37ea3d287661 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:43.055525 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-616da45c-85ce-487f-a561-37ea3d287661 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:43.210262 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-616da45c-85ce-487f-a561-37ea3d287661 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:43.218537 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-616da45c-85ce-487f-a561-37ea3d287661 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1755 microversion: 2.1 time: 0.177222 Aug 18 11:11:43.219099 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 442/899] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:43 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:44.240180 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4c9dab98-eada-4b04-a161-3af46e4dd911 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:44.240786 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4c9dab98-eada-4b04-a161-3af46e4dd911 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:44.248022 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c9dab98-eada-4b04-a161-3af46e4dd911 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:44.248498 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c9dab98-eada-4b04-a161-3af46e4dd911 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:44.248928 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c9dab98-eada-4b04-a161-3af46e4dd911 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:44.249650 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c9dab98-eada-4b04-a161-3af46e4dd911 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:44.250101 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c9dab98-eada-4b04-a161-3af46e4dd911 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:44.250517 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4c9dab98-eada-4b04-a161-3af46e4dd911 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:44.396522 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4c9dab98-eada-4b04-a161-3af46e4dd911 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:44.404620 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4c9dab98-eada-4b04-a161-3af46e4dd911 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1755 microversion: 2.1 time: 0.168248 Aug 18 11:11:44.405178 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 458/900] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:44 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:45.426793 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a7dacef2-40c0-4b3d-bff3-431cd30c9839 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:45.427314 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a7dacef2-40c0-4b3d-bff3-431cd30c9839 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:45.433845 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7dacef2-40c0-4b3d-bff3-431cd30c9839 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:45.434341 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7dacef2-40c0-4b3d-bff3-431cd30c9839 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:45.434780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7dacef2-40c0-4b3d-bff3-431cd30c9839 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:45.435475 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7dacef2-40c0-4b3d-bff3-431cd30c9839 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:45.435929 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7dacef2-40c0-4b3d-bff3-431cd30c9839 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:45.436355 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a7dacef2-40c0-4b3d-bff3-431cd30c9839 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:45.586010 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a7dacef2-40c0-4b3d-bff3-431cd30c9839 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:45.594545 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a7dacef2-40c0-4b3d-bff3-431cd30c9839 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1755 microversion: 2.1 time: 0.171914 Aug 18 11:11:45.595111 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 443/901] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:45 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:46.616194 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7de2c6ce-1103-4e76-a58d-7ca1006ee42c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:46.616735 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7de2c6ce-1103-4e76-a58d-7ca1006ee42c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:46.623590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7de2c6ce-1103-4e76-a58d-7ca1006ee42c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:46.624070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7de2c6ce-1103-4e76-a58d-7ca1006ee42c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:46.624499 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7de2c6ce-1103-4e76-a58d-7ca1006ee42c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:46.625290 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7de2c6ce-1103-4e76-a58d-7ca1006ee42c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:46.625671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7de2c6ce-1103-4e76-a58d-7ca1006ee42c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:46.626092 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7de2c6ce-1103-4e76-a58d-7ca1006ee42c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:46.628678 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=54 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:46.769010 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7de2c6ce-1103-4e76-a58d-7ca1006ee42c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:46.776980 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7de2c6ce-1103-4e76-a58d-7ca1006ee42c tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1755 microversion: 2.1 time: 0.164748 Aug 18 11:11:46.778735 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 459/902] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:46 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:47.800556 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-dc37ab01-c7ae-4097-a019-59aa9eccd709 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:47.801157 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-dc37ab01-c7ae-4097-a019-59aa9eccd709 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:47.807080 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc37ab01-c7ae-4097-a019-59aa9eccd709 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:47.807553 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc37ab01-c7ae-4097-a019-59aa9eccd709 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:47.807984 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc37ab01-c7ae-4097-a019-59aa9eccd709 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:47.808713 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc37ab01-c7ae-4097-a019-59aa9eccd709 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:47.809113 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc37ab01-c7ae-4097-a019-59aa9eccd709 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:47.809545 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dc37ab01-c7ae-4097-a019-59aa9eccd709 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:47.958455 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-dc37ab01-c7ae-4097-a019-59aa9eccd709 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:47.966967 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-dc37ab01-c7ae-4097-a019-59aa9eccd709 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1755 microversion: 2.1 time: 0.170705 Aug 18 11:11:47.967539 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 444/903] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:47 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:48.988605 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8af62676-8cb0-4a27-b769-680b5c8ba673 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:48.989210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8af62676-8cb0-4a27-b769-680b5c8ba673 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:48.996668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8af62676-8cb0-4a27-b769-680b5c8ba673 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:48.997156 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8af62676-8cb0-4a27-b769-680b5c8ba673 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:48.997627 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8af62676-8cb0-4a27-b769-680b5c8ba673 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:48.998363 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8af62676-8cb0-4a27-b769-680b5c8ba673 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:48.998857 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8af62676-8cb0-4a27-b769-680b5c8ba673 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:48.999316 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8af62676-8cb0-4a27-b769-680b5c8ba673 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:49.149475 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8af62676-8cb0-4a27-b769-680b5c8ba673 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:49.157664 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8af62676-8cb0-4a27-b769-680b5c8ba673 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1755 microversion: 2.1 time: 0.173096 Aug 18 11:11:49.158231 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 460/904] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:48 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:50.180825 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1a20c951-7ed8-4e46-aadd-ccbf4c7324eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:50.181449 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1a20c951-7ed8-4e46-aadd-ccbf4c7324eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:50.189473 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20c951-7ed8-4e46-aadd-ccbf4c7324eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:50.190000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20c951-7ed8-4e46-aadd-ccbf4c7324eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:50.190473 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20c951-7ed8-4e46-aadd-ccbf4c7324eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:50.191204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20c951-7ed8-4e46-aadd-ccbf4c7324eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:50.191660 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20c951-7ed8-4e46-aadd-ccbf4c7324eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:50.192086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1a20c951-7ed8-4e46-aadd-ccbf4c7324eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:50.344532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1a20c951-7ed8-4e46-aadd-ccbf4c7324eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:50.352780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1a20c951-7ed8-4e46-aadd-ccbf4c7324eb tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1755 microversion: 2.1 time: 0.176400 Aug 18 11:11:50.353361 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 445/905] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:50 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:11:51.376038 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-026db67b-86e0-4a9a-b801-c3250d821241 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:11:51.376652 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-026db67b-86e0-4a9a-b801-c3250d821241 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:11:51.383394 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-026db67b-86e0-4a9a-b801-c3250d821241 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:51.383827 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-026db67b-86e0-4a9a-b801-c3250d821241 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:51.384265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-026db67b-86e0-4a9a-b801-c3250d821241 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:51.384955 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-026db67b-86e0-4a9a-b801-c3250d821241 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:11:51.385439 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-026db67b-86e0-4a9a-b801-c3250d821241 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:11:51.385928 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-026db67b-86e0-4a9a-b801-c3250d821241 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:11:51.684775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-026db67b-86e0-4a9a-b801-c3250d821241 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:11:51.693036 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-026db67b-86e0-4a9a-b801-c3250d821241 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1758 microversion: 2.1 time: 0.320916 Aug 18 11:11:51.693615 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 461/906] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:11:51 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1758 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:12:06.407473 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-90b2be60-2edb-4018-884a-86745bee87eb tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:06.408078 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-90b2be60-2edb-4018-884a-86745bee87eb tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:06.410783 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=12 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:06.411464 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:06.417458 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90b2be60-2edb-4018-884a-86745bee87eb tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:06.418329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90b2be60-2edb-4018-884a-86745bee87eb tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:06.418787 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90b2be60-2edb-4018-884a-86745bee87eb tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:06.419495 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90b2be60-2edb-4018-884a-86745bee87eb tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:06.419957 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90b2be60-2edb-4018-884a-86745bee87eb tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:06.420390 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-90b2be60-2edb-4018-884a-86745bee87eb tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:06.445569 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-90b2be60-2edb-4018-884a-86745bee87eb tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/ips" status: 200 len: 146 microversion: 2.1 time: 0.042336 Aug 18 11:12:06.446141 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 446/907] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Aug 18 11:12:06 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:12:07.775111 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8a4c0f41-4c9d-4b54-bc66-954e86050739 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f553777e-75ee-4210-9471-e416f473659b"}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:12:07.778247 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8a4c0f41-4c9d-4b54-bc66-954e86050739 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:07.780383 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=11 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:07.781034 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=17 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:07.786663 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8a4c0f41-4c9d-4b54-bc66-954e86050739 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:07.787149 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8a4c0f41-4c9d-4b54-bc66-954e86050739 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:07.787579 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8a4c0f41-4c9d-4b54-bc66-954e86050739 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:07.788270 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8a4c0f41-4c9d-4b54-bc66-954e86050739 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:07.788720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8a4c0f41-4c9d-4b54-bc66-954e86050739 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:07.789137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8a4c0f41-4c9d-4b54-bc66-954e86050739 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:08.033800 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8a4c0f41-4c9d-4b54-bc66-954e86050739 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262455 Aug 18 11:12:08.034384 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 462/908] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:12:07 2022] POST /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:14.510185 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c3bea7e2-35c3-468c-bc6d-6cd22974f9bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:14.513109 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c3bea7e2-35c3-468c-bc6d-6cd22974f9bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:14.519654 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3bea7e2-35c3-468c-bc6d-6cd22974f9bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:14.520141 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3bea7e2-35c3-468c-bc6d-6cd22974f9bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:14.520583 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3bea7e2-35c3-468c-bc6d-6cd22974f9bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:14.521278 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3bea7e2-35c3-468c-bc6d-6cd22974f9bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:14.521766 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3bea7e2-35c3-468c-bc6d-6cd22974f9bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:14.522193 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c3bea7e2-35c3-468c-bc6d-6cd22974f9bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:14.553904 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c3bea7e2-35c3-468c-bc6d-6cd22974f9bc tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047601 Aug 18 11:12:14.554579 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 447/909] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:12:14 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:14.568359 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1e2f94a6-0ff2-48a6-9e77-4c10ea1386cd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:14.568973 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1e2f94a6-0ff2-48a6-9e77-4c10ea1386cd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:14.575247 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e2f94a6-0ff2-48a6-9e77-4c10ea1386cd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:14.575725 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e2f94a6-0ff2-48a6-9e77-4c10ea1386cd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:14.576160 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e2f94a6-0ff2-48a6-9e77-4c10ea1386cd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:14.576848 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e2f94a6-0ff2-48a6-9e77-4c10ea1386cd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:14.577294 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e2f94a6-0ff2-48a6-9e77-4c10ea1386cd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:14.577745 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e2f94a6-0ff2-48a6-9e77-4c10ea1386cd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:14.605123 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1e2f94a6-0ff2-48a6-9e77-4c10ea1386cd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments/f553777e-75ee-4210-9471-e416f473659b" status: 200 len: 194 microversion: 2.1 time: 0.041622 Aug 18 11:12:14.606388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 463/910] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Aug 18 11:12:14 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments/f553777e-75ee-4210-9471-e416f473659b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:15.964371 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1ec1957f-26be-4f79-895c-c8596a923a7b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bbf98bc-3abb-4c3e-9937-fa80f28fdc2d"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:12:15.966972 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1ec1957f-26be-4f79-895c-c8596a923a7b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:15.973352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ec1957f-26be-4f79-895c-c8596a923a7b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:15.973866 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ec1957f-26be-4f79-895c-c8596a923a7b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:15.974303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ec1957f-26be-4f79-895c-c8596a923a7b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:15.974989 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ec1957f-26be-4f79-895c-c8596a923a7b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:15.975442 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ec1957f-26be-4f79-895c-c8596a923a7b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:15.975864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1ec1957f-26be-4f79-895c-c8596a923a7b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:16.231112 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1ec1957f-26be-4f79-895c-c8596a923a7b tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "POST /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269863 Aug 18 11:12:16.231707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 448/911] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:12:15 2022] POST /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:23.784922 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-53df1da0-d921-4cc0-b3d9-7d2163b27f0e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:23.787192 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-53df1da0-d921-4cc0-b3d9-7d2163b27f0e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:23.793753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53df1da0-d921-4cc0-b3d9-7d2163b27f0e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:23.795168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53df1da0-d921-4cc0-b3d9-7d2163b27f0e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:23.795314 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53df1da0-d921-4cc0-b3d9-7d2163b27f0e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:23.795978 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53df1da0-d921-4cc0-b3d9-7d2163b27f0e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:23.796437 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53df1da0-d921-4cc0-b3d9-7d2163b27f0e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:23.796863 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53df1da0-d921-4cc0-b3d9-7d2163b27f0e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:23.827272 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-53df1da0-d921-4cc0-b3d9-7d2163b27f0e tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046236 Aug 18 11:12:23.827819 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 464/912] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:12:23 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:23.968058 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5686a361-98d8-4328-953f-40962e1e1756 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:23.968612 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5686a361-98d8-4328-953f-40962e1e1756 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:23.974958 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5686a361-98d8-4328-953f-40962e1e1756 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:23.975469 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5686a361-98d8-4328-953f-40962e1e1756 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:23.975934 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5686a361-98d8-4328-953f-40962e1e1756 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:23.976629 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5686a361-98d8-4328-953f-40962e1e1756 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:23.977093 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5686a361-98d8-4328-953f-40962e1e1756 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:23.977538 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5686a361-98d8-4328-953f-40962e1e1756 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:24.006496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5686a361-98d8-4328-953f-40962e1e1756 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments/f553777e-75ee-4210-9471-e416f473659b" status: 200 len: 194 microversion: 2.1 time: 0.043916 Aug 18 11:12:24.007077 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 449/913] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Aug 18 11:12:23 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments/f553777e-75ee-4210-9471-e416f473659b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:24.017217 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-3160a7c7-bbed-4101-bc3d-a14d57b01d1c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:24.017755 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-3160a7c7-bbed-4101-bc3d-a14d57b01d1c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:24.023615 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3160a7c7-bbed-4101-bc3d-a14d57b01d1c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:24.024100 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3160a7c7-bbed-4101-bc3d-a14d57b01d1c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:24.024529 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3160a7c7-bbed-4101-bc3d-a14d57b01d1c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:24.025215 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3160a7c7-bbed-4101-bc3d-a14d57b01d1c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:24.025701 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3160a7c7-bbed-4101-bc3d-a14d57b01d1c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:24.026124 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-3160a7c7-bbed-4101-bc3d-a14d57b01d1c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:24.114475 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-3160a7c7-bbed-4101-bc3d-a14d57b01d1c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lazy-loading 'services' on Instance uuid 829cc03a-13f5-48fd-9069-a9f21d4b9758 {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:12:24.126331 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-562a1314-8091-491b-8936-6da422039c50 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-459029098"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:12:24.126853 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-562a1314-8091-491b-8936-6da422039c50 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:24.133175 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-562a1314-8091-491b-8936-6da422039c50 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:24.133687 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-562a1314-8091-491b-8936-6da422039c50 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:24.134114 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-562a1314-8091-491b-8936-6da422039c50 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:24.134805 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-562a1314-8091-491b-8936-6da422039c50 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:24.135232 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-562a1314-8091-491b-8936-6da422039c50 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:24.135655 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-562a1314-8091-491b-8936-6da422039c50 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:24.194941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-3160a7c7-bbed-4101-bc3d-a14d57b01d1c tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "DELETE /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments/f553777e-75ee-4210-9471-e416f473659b" status: 202 len: 0 microversion: 2.1 time: 0.181366 Aug 18 11:12:24.195707 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 465/914] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:12:24 2022] DELETE /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments/f553777e-75ee-4210-9471-e416f473659b => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:12:24.282068 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.network.security_group_api [None req-562a1314-8091-491b-8936-6da422039c50 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Removing security group 079a9872-a5fd-4e20-8ad4-d8148111c98e from port 490cedd8-1283-4951-bc9b-5dd41c51a56c Aug 18 11:12:24.595195 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-562a1314-8091-491b-8936-6da422039c50 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "POST /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/action" status: 202 len: 0 microversion: 2.1 time: 0.473270 Aug 18 11:12:24.596007 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 450/915] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Aug 18 11:12:24 2022] POST /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:12:24.610546 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-66784f07-3c25-48f4-ba77-93ee757a91fa req-b6ae993e-276a-4140-abb8-25e097d12d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0a1d6b-a999-4c67-b558-fa17a12a486b", "tag": "490cedd8-1283-4951-bc9b-5dd41c51a56c"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:12:24.628685 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-66784f07-3c25-48f4-ba77-93ee757a91fa req-b6ae993e-276a-4140-abb8-25e097d12d6e service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:24.629551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-66784f07-3c25-48f4-ba77-93ee757a91fa req-b6ae993e-276a-4140-abb8-25e097d12d6e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:24.630202 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-66784f07-3c25-48f4-ba77-93ee757a91fa req-b6ae993e-276a-4140-abb8-25e097d12d6e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:24.643768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-66784f07-3c25-48f4-ba77-93ee757a91fa req-b6ae993e-276a-4140-abb8-25e097d12d6e service nova] Creating event network-changed:490cedd8-1283-4951-bc9b-5dd41c51a56c for instance ef0a1d6b-a999-4c67-b558-fa17a12a486b on hv-cinder-82660 Aug 18 11:12:24.649194 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-66784f07-3c25-48f4-ba77-93ee757a91fa req-b6ae993e-276a-4140-abb8-25e097d12d6e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046342 Aug 18 11:12:24.650378 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 466/916] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:25.333610 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4db02992-3655-475c-8893-6c7ab9292710 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:25.334178 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4db02992-3655-475c-8893-6c7ab9292710 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:25.340256 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4db02992-3655-475c-8893-6c7ab9292710 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:25.340786 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4db02992-3655-475c-8893-6c7ab9292710 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:25.342027 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4db02992-3655-475c-8893-6c7ab9292710 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:25.342848 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4db02992-3655-475c-8893-6c7ab9292710 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:25.343387 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4db02992-3655-475c-8893-6c7ab9292710 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:25.343811 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4db02992-3655-475c-8893-6c7ab9292710 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:25.373853 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4db02992-3655-475c-8893-6c7ab9292710 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments/1bbf98bc-3abb-4c3e-9937-fa80f28fdc2d" status: 200 len: 194 microversion: 2.1 time: 0.044750 Aug 18 11:12:25.374556 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 451/917] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Aug 18 11:12:25 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments/1bbf98bc-3abb-4c3e-9937-fa80f28fdc2d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:12:25.385223 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-31910394-8984-46b1-a813-de418f4f7abd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:25.385830 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-31910394-8984-46b1-a813-de418f4f7abd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:25.392763 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31910394-8984-46b1-a813-de418f4f7abd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:25.393252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31910394-8984-46b1-a813-de418f4f7abd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:25.393720 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31910394-8984-46b1-a813-de418f4f7abd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:25.394414 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31910394-8984-46b1-a813-de418f4f7abd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:25.394863 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31910394-8984-46b1-a813-de418f4f7abd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:25.395283 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31910394-8984-46b1-a813-de418f4f7abd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:25.482823 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-31910394-8984-46b1-a813-de418f4f7abd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lazy-loading 'services' on Instance uuid 829cc03a-13f5-48fd-9069-a9f21d4b9758 {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:12:25.564920 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-31910394-8984-46b1-a813-de418f4f7abd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "DELETE /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments/1bbf98bc-3abb-4c3e-9937-fa80f28fdc2d" status: 202 len: 0 microversion: 2.1 time: 0.183725 Aug 18 11:12:25.565503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 467/918] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:12:25 2022] DELETE /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments/1bbf98bc-3abb-4c3e-9937-fa80f28fdc2d => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:12:26.361392 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3b67e7d0-c7d6-48bb-9a69-9d524970a29d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:26.361995 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3b67e7d0-c7d6-48bb-9a69-9d524970a29d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:26.368489 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b67e7d0-c7d6-48bb-9a69-9d524970a29d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:26.369053 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b67e7d0-c7d6-48bb-9a69-9d524970a29d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:26.369594 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b67e7d0-c7d6-48bb-9a69-9d524970a29d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:26.370364 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b67e7d0-c7d6-48bb-9a69-9d524970a29d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:26.370891 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b67e7d0-c7d6-48bb-9a69-9d524970a29d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:26.371388 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b67e7d0-c7d6-48bb-9a69-9d524970a29d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:26.456338 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-3b67e7d0-c7d6-48bb-9a69-9d524970a29d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lazy-loading 'services' on Instance uuid ef0a1d6b-a999-4c67-b558-fa17a12a486b {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:12:26.531608 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3b67e7d0-c7d6-48bb-9a69-9d524970a29d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments/905b3036-cf1c-4598-ae3f-c81d516ba163" status: 202 len: 0 microversion: 2.1 time: 0.174073 Aug 18 11:12:26.532248 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 452/919] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:12:26 2022] DELETE /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments/905b3036-cf1c-4598-ae3f-c81d516ba163 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:12:26.541672 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-68097d2f-e2a3-4ca4-9b7a-2cb170dafe63 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:26.544128 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-68097d2f-e2a3-4ca4-9b7a-2cb170dafe63 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:26.553982 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68097d2f-e2a3-4ca4-9b7a-2cb170dafe63 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:26.554583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68097d2f-e2a3-4ca4-9b7a-2cb170dafe63 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:26.555264 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68097d2f-e2a3-4ca4-9b7a-2cb170dafe63 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:26.556056 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68097d2f-e2a3-4ca4-9b7a-2cb170dafe63 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:26.556606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68097d2f-e2a3-4ca4-9b7a-2cb170dafe63 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:26.557102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68097d2f-e2a3-4ca4-9b7a-2cb170dafe63 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:26.590982 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-68097d2f-e2a3-4ca4-9b7a-2cb170dafe63 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054117 Aug 18 11:12:26.591630 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 468/920] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:12:26 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:26.667119 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-3d3838fc-7b93-45a9-a39e-c3f9ca5cc346 req-e378de55-01c3-48c9-adfc-78c6d1faa13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0a1d6b-a999-4c67-b558-fa17a12a486b", "tag": "490cedd8-1283-4951-bc9b-5dd41c51a56c"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:12:26.679039 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-3d3838fc-7b93-45a9-a39e-c3f9ca5cc346 req-e378de55-01c3-48c9-adfc-78c6d1faa13d service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:26.679731 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-3d3838fc-7b93-45a9-a39e-c3f9ca5cc346 req-e378de55-01c3-48c9-adfc-78c6d1faa13d service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:26.680353 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-3d3838fc-7b93-45a9-a39e-c3f9ca5cc346 req-e378de55-01c3-48c9-adfc-78c6d1faa13d service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:26.702197 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-3d3838fc-7b93-45a9-a39e-c3f9ca5cc346 req-e378de55-01c3-48c9-adfc-78c6d1faa13d service nova] Creating event network-changed:490cedd8-1283-4951-bc9b-5dd41c51a56c for instance ef0a1d6b-a999-4c67-b558-fa17a12a486b on hv-cinder-82660 Aug 18 11:12:26.707736 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-3d3838fc-7b93-45a9-a39e-c3f9ca5cc346 req-e378de55-01c3-48c9-adfc-78c6d1faa13d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044580 Aug 18 11:12:26.708519 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 453/921] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:12:26.768093 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-06f61137-03e1-4602-bb8b-a1fecdcadeec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:26.770271 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-06f61137-03e1-4602-bb8b-a1fecdcadeec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:26.776132 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06f61137-03e1-4602-bb8b-a1fecdcadeec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:26.776618 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06f61137-03e1-4602-bb8b-a1fecdcadeec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:26.777055 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06f61137-03e1-4602-bb8b-a1fecdcadeec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:26.777803 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06f61137-03e1-4602-bb8b-a1fecdcadeec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:26.778263 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06f61137-03e1-4602-bb8b-a1fecdcadeec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:26.778815 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-06f61137-03e1-4602-bb8b-a1fecdcadeec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:26.810652 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-06f61137-03e1-4602-bb8b-a1fecdcadeec tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045703 Aug 18 11:12:26.811244 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 469/922] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:12:26 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:12:26.937396 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b3f12302-9cb5-434c-9215-b6a4ae8fad79 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:26.939991 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b3f12302-9cb5-434c-9215-b6a4ae8fad79 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:26.946972 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3f12302-9cb5-434c-9215-b6a4ae8fad79 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:26.947457 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3f12302-9cb5-434c-9215-b6a4ae8fad79 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:26.947991 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3f12302-9cb5-434c-9215-b6a4ae8fad79 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:26.948809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3f12302-9cb5-434c-9215-b6a4ae8fad79 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:26.949259 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3f12302-9cb5-434c-9215-b6a4ae8fad79 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:26.949722 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b3f12302-9cb5-434c-9215-b6a4ae8fad79 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:26.999406 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b3f12302-9cb5-434c-9215-b6a4ae8fad79 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067482 Aug 18 11:12:27.000346 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 454/923] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:12:26 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:12:27.092510 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d6dbd884-b74c-42de-8a3f-342573850542 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:27.093216 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d6dbd884-b74c-42de-8a3f-342573850542 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:27.099222 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6dbd884-b74c-42de-8a3f-342573850542 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:27.099782 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6dbd884-b74c-42de-8a3f-342573850542 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:27.100431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6dbd884-b74c-42de-8a3f-342573850542 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:27.101338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6dbd884-b74c-42de-8a3f-342573850542 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:27.101833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6dbd884-b74c-42de-8a3f-342573850542 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:27.102280 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6dbd884-b74c-42de-8a3f-342573850542 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:27.129068 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d6dbd884-b74c-42de-8a3f-342573850542 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Going to try to terminate instance {{(pid=120800) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:12:27.249987 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-d6dbd884-b74c-42de-8a3f-342573850542 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "DELETE /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 204 len: 0 microversion: 2.1 time: 0.161288 Aug 18 11:12:27.250518 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 470/924] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:12:27 2022] DELETE /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:12:27.258757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-972a05e2-5e49-4a98-b6bf-137011e83743 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:27.259370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-972a05e2-5e49-4a98-b6bf-137011e83743 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:27.266201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-972a05e2-5e49-4a98-b6bf-137011e83743 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:27.266720 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-972a05e2-5e49-4a98-b6bf-137011e83743 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:27.267158 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-972a05e2-5e49-4a98-b6bf-137011e83743 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:27.267858 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-972a05e2-5e49-4a98-b6bf-137011e83743 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:27.268310 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-972a05e2-5e49-4a98-b6bf-137011e83743 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:27.268737 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-972a05e2-5e49-4a98-b6bf-137011e83743 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:27.410089 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-972a05e2-5e49-4a98-b6bf-137011e83743 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:12:27.418143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-972a05e2-5e49-4a98-b6bf-137011e83743 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1673 microversion: 2.1 time: 0.163259 Aug 18 11:12:27.418744 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 455/925] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:27 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:12:27.603888 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ae2a234a-ed2d-4171-935b-b08eebca45d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:27.606297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ae2a234a-ed2d-4171-935b-b08eebca45d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:27.612976 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae2a234a-ed2d-4171-935b-b08eebca45d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:27.613503 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae2a234a-ed2d-4171-935b-b08eebca45d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:27.613908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae2a234a-ed2d-4171-935b-b08eebca45d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:27.614635 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae2a234a-ed2d-4171-935b-b08eebca45d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:27.615089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae2a234a-ed2d-4171-935b-b08eebca45d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:27.615506 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ae2a234a-ed2d-4171-935b-b08eebca45d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:27.644545 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ae2a234a-ed2d-4171-935b-b08eebca45d0 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 Aug 18 11:12:27.645101 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 471/926] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:12:27 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:28.441267 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-f18c6ccb-ff7a-4fe4-a106-48f284142d66 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:28.441901 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-f18c6ccb-ff7a-4fe4-a106-48f284142d66 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:28.448371 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f18c6ccb-ff7a-4fe4-a106-48f284142d66 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:28.448854 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f18c6ccb-ff7a-4fe4-a106-48f284142d66 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:28.449291 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f18c6ccb-ff7a-4fe4-a106-48f284142d66 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:28.450019 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f18c6ccb-ff7a-4fe4-a106-48f284142d66 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:28.450607 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f18c6ccb-ff7a-4fe4-a106-48f284142d66 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:28.451270 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-f18c6ccb-ff7a-4fe4-a106-48f284142d66 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:28.594914 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-f18c6ccb-ff7a-4fe4-a106-48f284142d66 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:12:28.602702 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-f18c6ccb-ff7a-4fe4-a106-48f284142d66 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1673 microversion: 2.1 time: 0.165258 Aug 18 11:12:28.603294 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 456/927] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:28 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:12:28.658107 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-cb46294c-fc19-48e5-9956-de06e79ec7d7 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:28.661707 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-cb46294c-fc19-48e5-9956-de06e79ec7d7 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:28.671247 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb46294c-fc19-48e5-9956-de06e79ec7d7 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:28.671885 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb46294c-fc19-48e5-9956-de06e79ec7d7 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:28.672723 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb46294c-fc19-48e5-9956-de06e79ec7d7 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:28.673572 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb46294c-fc19-48e5-9956-de06e79ec7d7 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:28.674112 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb46294c-fc19-48e5-9956-de06e79ec7d7 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:28.674535 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cb46294c-fc19-48e5-9956-de06e79ec7d7 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:28.703127 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-cb46294c-fc19-48e5-9956-de06e79ec7d7 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050639 Aug 18 11:12:28.703696 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 472/928] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Aug 18 11:12:28 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:12:28.714176 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:28.714674 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:28.721923 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:28.722649 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:28.723146 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:28.723795 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:28.724277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:28.724703 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:28.807324 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] HTTP exception thrown: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b is not attached to volume 905b3036-cf1c-4598-ae3f-c81d516ba163 Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Request method failure captured: Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: DELETE /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments/905b3036-cf1c-4598-ae3f-c81d516ba163 HTTP/1.1 Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_h4jM126MA-J05pLk1jPQrJZw7175yoSOAtAL87JBenIDZ6IUdE_GAEGGZAG5hqZM5PEvTRJvh2wnbofUeXy8qc1wezWXQ77Hq4C26AvfoOMGvxoGslHEo83dW2W7R4lygC1kK6PChZiVZUhbnWI5YCa9AdZl4TtSVnJQV_hFta2_9I Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 2b0506e20fb94a929cf6703c6a52f8d2 Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-TestMinimumBasicScenario-654903542 Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:12:28.809794 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2b0506e20fb94a929cf6703c6a52f8d2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2b0506e20fb94a929cf6703c6a52f8d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2b0506e20fb94a929cf6703c6a52f8d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2b0506e20fb94a929cf6703c6a52f8d2"}]}] Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-TestMinimumBasicScenario-654903542 Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 2b0506e20fb94a929cf6703c6a52f8d2 Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-TestMinimumBasicScenario-654903542 Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-TestMinimumBasicScenario-654903542-project Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 937b232bfc72467c96829aff438cdecb Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-TestMinimumBasicScenario-654903542-project Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:12:28.811528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b is not attached to volume 905b3036-cf1c-4598-ae3f-c81d516ba163 Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'server_id': 'ef0a1d6b-a999-4c67-b558-fa17a12a486b', 'id': '905b3036-cf1c-4598-ae3f-c81d516ba163'} Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 905b3036-cf1c-4598-ae3f-c81d516ba163. Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:12:28.812587 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b is not attached to volume 905b3036-cf1c-4598-ae3f-c81d516ba163 Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b is not attached to volume 905b3036-cf1c-4598-ae3f-c81d516ba163 Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:28.814245 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Returning 404 to user: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b is not attached to volume 905b3036-cf1c-4598-ae3f-c81d516ba163 {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:12:28.815510 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-82b43511-75e5-4960-ba28-76f7746ba899 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments/905b3036-cf1c-4598-ae3f-c81d516ba163" status: 404 len: 154 microversion: 2.1 time: 0.101112 Aug 18 11:12:28.815510 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 457/929] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:12:28 2022] DELETE /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b/os-volume_attachments/905b3036-cf1c-4598-ae3f-c81d516ba163 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:12:29.625316 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-46554b79-392f-478e-bed1-b03a1f7502a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:29.626102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-46554b79-392f-478e-bed1-b03a1f7502a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:29.632055 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46554b79-392f-478e-bed1-b03a1f7502a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:29.632605 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46554b79-392f-478e-bed1-b03a1f7502a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:29.633115 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46554b79-392f-478e-bed1-b03a1f7502a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:29.633884 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46554b79-392f-478e-bed1-b03a1f7502a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:29.634422 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46554b79-392f-478e-bed1-b03a1f7502a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:29.634906 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-46554b79-392f-478e-bed1-b03a1f7502a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:29.699564 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-46554b79-392f-478e-bed1-b03a1f7502a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:12:29.707758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-46554b79-392f-478e-bed1-b03a1f7502a7 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1605 microversion: 2.1 time: 0.087039 Aug 18 11:12:29.708332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 473/930] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:29 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1605 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:12:29.777395 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-9a90375a-9718-432b-9217-536bb4f0617a req-0b343a45-e9b8-42d5-aca9-2bab9584534e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829cc03a-13f5-48fd-9069-a9f21d4b9758", "name": "network-vif-deleted", "tag": "de1962c2-9b10-426f-8ede-e567e6c7edae"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:12:29.787979 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-9a90375a-9718-432b-9217-536bb4f0617a req-0b343a45-e9b8-42d5-aca9-2bab9584534e service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:29.788278 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-9a90375a-9718-432b-9217-536bb4f0617a req-0b343a45-e9b8-42d5-aca9-2bab9584534e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:29.788979 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-9a90375a-9718-432b-9217-536bb4f0617a req-0b343a45-e9b8-42d5-aca9-2bab9584534e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:29.803206 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-9a90375a-9718-432b-9217-536bb4f0617a req-0b343a45-e9b8-42d5-aca9-2bab9584534e service nova] Creating event network-vif-deleted:de1962c2-9b10-426f-8ede-e567e6c7edae for instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 on hv-cinder-82660 Aug 18 11:12:29.808514 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-9a90375a-9718-432b-9217-536bb4f0617a req-0b343a45-e9b8-42d5-aca9-2bab9584534e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035545 Aug 18 11:12:29.809478 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 458/931] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:29.967900 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b701a618-168d-47e0-a7c6-b712e7fc4ab5 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:29.968412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b701a618-168d-47e0-a7c6-b712e7fc4ab5 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:29.975051 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b701a618-168d-47e0-a7c6-b712e7fc4ab5 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:29.975552 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b701a618-168d-47e0-a7c6-b712e7fc4ab5 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:29.975986 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b701a618-168d-47e0-a7c6-b712e7fc4ab5 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:29.976804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b701a618-168d-47e0-a7c6-b712e7fc4ab5 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:29.977434 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b701a618-168d-47e0-a7c6-b712e7fc4ab5 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:29.978091 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b701a618-168d-47e0-a7c6-b712e7fc4ab5 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:30.009940 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b701a618-168d-47e0-a7c6-b712e7fc4ab5 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Going to try to terminate instance {{(pid=120800) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:12:30.013924 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:30.092364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b701a618-168d-47e0-a7c6-b712e7fc4ab5 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 204 len: 0 microversion: 2.1 time: 0.128542 Aug 18 11:12:30.092903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 474/932] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:12:29 2022] DELETE /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:12:30.101477 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-442836e2-659e-4ee4-80d7-160f6b56a346 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:30.102202 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-442836e2-659e-4ee4-80d7-160f6b56a346 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:30.109183 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-442836e2-659e-4ee4-80d7-160f6b56a346 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:30.109714 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-442836e2-659e-4ee4-80d7-160f6b56a346 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:30.110198 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-442836e2-659e-4ee4-80d7-160f6b56a346 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:30.110854 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-442836e2-659e-4ee4-80d7-160f6b56a346 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:30.111317 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-442836e2-659e-4ee4-80d7-160f6b56a346 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:30.111754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-442836e2-659e-4ee4-80d7-160f6b56a346 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:30.258832 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-442836e2-659e-4ee4-80d7-160f6b56a346 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:12:30.266756 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-442836e2-659e-4ee4-80d7-160f6b56a346 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1554 microversion: 2.1 time: 0.169399 Aug 18 11:12:30.267325 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 459/933] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:30 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:12:30.729902 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:30.730590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:30.737799 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:30.738285 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:30.738712 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:30.739402 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:30.739847 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:30.740268 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:30.772058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:30.772537 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:30.772969 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:30.773418 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lazy-loading 'fault' on Instance uuid 829cc03a-13f5-48fd-9069-a9f21d4b9758 {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:12:30.820658 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932e75ccffec4118b9de434cc59564f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dd094c20324a7e8bfe6f3ea11dce38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:12:30.829631 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9fa91c7f-8c72-435a-9678-0cd278221a52 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 200 len: 1326 microversion: 2.1 time: 0.103848 Aug 18 11:12:30.830141 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 475/934] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:30 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:12:31.289987 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b03ffbd2-6f4f-4ab7-b939-815e39f1207d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:31.291098 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b03ffbd2-6f4f-4ab7-b939-815e39f1207d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:31.298632 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b03ffbd2-6f4f-4ab7-b939-815e39f1207d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:31.299120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b03ffbd2-6f4f-4ab7-b939-815e39f1207d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:31.299564 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b03ffbd2-6f4f-4ab7-b939-815e39f1207d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:31.300266 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b03ffbd2-6f4f-4ab7-b939-815e39f1207d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:31.300721 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b03ffbd2-6f4f-4ab7-b939-815e39f1207d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:31.301148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b03ffbd2-6f4f-4ab7-b939-815e39f1207d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:31.435908 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b03ffbd2-6f4f-4ab7-b939-815e39f1207d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:12:31.443479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b03ffbd2-6f4f-4ab7-b939-815e39f1207d tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1554 microversion: 2.1 time: 0.158296 Aug 18 11:12:31.444050 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 460/935] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:31 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:12:31.851682 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:31.852409 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:31.860145 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:31.860731 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:31.861164 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:31.861900 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:31.862355 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:31.862786 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:31.877806 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] HTTP exception thrown: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Request method failure captured: Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 HTTP/1.1 Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_h2ZlHFg0ZNbiYtbz_Dz90irfMjnd7sCsLGgtFUHuF0d-Cnpuk3h6uG08wfaZuQb4VPqgA5aVM5faXO_rlmv0GoNc0_3pJ96PnAEh0OcpIo4ptTrSWZ1w_umYr3a-mLbhYBegEYwPZELiGKpCVS3YjnqPYyh46Eqnjgq5MUMeKfN12U Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:12:31.879465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c2dd094c20324a7e8bfe6f3ea11dce38", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c2dd094c20324a7e8bfe6f3ea11dce38"}]}] Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 932e75ccffec4118b9de434cc59564f7 Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:31.880905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '829cc03a-13f5-48fd-9069-a9f21d4b9758'} Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:12:31.881916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:31.883662 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:31.885033 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Returning 404 to user: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:12:31.885033 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-53e3c33c-f4cd-4b6b-90e2-a8515d19e06d tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 404 len: 111 microversion: 2.1 time: 0.033067 Aug 18 11:12:31.885033 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 476/936] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:31 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:12:31.889844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-79b277ee-8d3f-4af8-893a-43479a04a734 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '.version_select at 0x7f7ec89cf9d0>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:31.911012 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-79b277ee-8d3f-4af8-893a-43479a04a734 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-813108211" status: 202 len: 0 microversion: 2.1 time: 0.025078 Aug 18 11:12:31.911607 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 461/937] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Aug 18 11:12:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-813108211 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:12:32.423085 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-543231cc-022e-4bdb-8a42-3c5396fdeebb req-b863984d-d115-4670-b670-3c997964c681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0a1d6b-a999-4c67-b558-fa17a12a486b", "name": "network-vif-deleted", "tag": "490cedd8-1283-4951-bc9b-5dd41c51a56c"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:12:32.433644 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-543231cc-022e-4bdb-8a42-3c5396fdeebb req-b863984d-d115-4670-b670-3c997964c681 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:32.435025 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-543231cc-022e-4bdb-8a42-3c5396fdeebb req-b863984d-d115-4670-b670-3c997964c681 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:32.435868 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-543231cc-022e-4bdb-8a42-3c5396fdeebb req-b863984d-d115-4670-b670-3c997964c681 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:32.448187 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-543231cc-022e-4bdb-8a42-3c5396fdeebb req-b863984d-d115-4670-b670-3c997964c681 service nova] Creating event network-vif-deleted:490cedd8-1283-4951-bc9b-5dd41c51a56c for instance ef0a1d6b-a999-4c67-b558-fa17a12a486b on hv-cinder-82660 Aug 18 11:12:32.454472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-543231cc-022e-4bdb-8a42-3c5396fdeebb req-b863984d-d115-4670-b670-3c997964c681 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035627 Aug 18 11:12:32.455252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 477/938] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:12:32.464805 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-cbf1336a-fb94-4e5e-a057-474988a7a88f tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:32.465431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-cbf1336a-fb94-4e5e-a057-474988a7a88f tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:32.479617 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cbf1336a-fb94-4e5e-a057-474988a7a88f tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:32.480130 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cbf1336a-fb94-4e5e-a057-474988a7a88f tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:32.480623 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cbf1336a-fb94-4e5e-a057-474988a7a88f tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:32.481367 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cbf1336a-fb94-4e5e-a057-474988a7a88f tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:32.482471 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cbf1336a-fb94-4e5e-a057-474988a7a88f tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:32.482911 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cbf1336a-fb94-4e5e-a057-474988a7a88f tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:32.554110 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-cbf1336a-fb94-4e5e-a057-474988a7a88f tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937b232bfc72467c96829aff438cdecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0506e20fb94a929cf6703c6a52f8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:12:32.562700 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-cbf1336a-fb94-4e5e-a057-474988a7a88f tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 200 len: 1343 microversion: 2.1 time: 0.102337 Aug 18 11:12:32.563282 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 462/939] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:32 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 1343 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:12:33.585073 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:33.585817 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] [instance: ef0a1d6b-a999-4c67-b558-fa17a12a486b] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:33.593042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:33.593538 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:33.593989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:33.594688 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:33.595144 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:33.595572 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:33.609767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] HTTP exception thrown: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b could not be found. Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Request method failure captured: Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b HTTP/1.1 Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_h4jM126MA-J05pLk1jPQrJZw7175yoSOAtAL87JBenIDZ6IUdE_GAEGGZAG5hqZM5PEvTRJvh2wnbofUeXy8qc1wezWXQ77Hq4C26AvfoOMGvxoGslHEo83dW2W7R4lygC1kK6PChZiVZUhbnWI5YCa9AdZl4TtSVnJQV_hFta2_9I Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 2b0506e20fb94a929cf6703c6a52f8d2 Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-TestMinimumBasicScenario-654903542 Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:12:33.611431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2b0506e20fb94a929cf6703c6a52f8d2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2b0506e20fb94a929cf6703c6a52f8d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2b0506e20fb94a929cf6703c6a52f8d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2b0506e20fb94a929cf6703c6a52f8d2"}]}] Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-TestMinimumBasicScenario-654903542 Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 2b0506e20fb94a929cf6703c6a52f8d2 Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-TestMinimumBasicScenario-654903542 Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-TestMinimumBasicScenario-654903542-project Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 937b232bfc72467c96829aff438cdecb Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-TestMinimumBasicScenario-654903542-project Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b could not be found. Aug 18 11:12:33.612952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': 'ef0a1d6b-a999-4c67-b558-fa17a12a486b'} Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b could not be found. Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:12:33.613894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b could not be found. Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b could not be found. Aug 18 11:12:33.615334 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:33.616674 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Returning 404 to user: Instance ef0a1d6b-a999-4c67-b558-fa17a12a486b could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:12:33.616674 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5e737bff-81d9-4fd8-a1c1-72387fe646bf tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b" status: 404 len: 111 microversion: 2.1 time: 0.032496 Aug 18 11:12:33.616674 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 478/940] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:33 2022] GET /compute/v2.1/servers/ef0a1d6b-a999-4c67-b558-fa17a12a486b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:12:33.621719 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-03c31611-f739-49c1-a461-97921db6a264 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] Calling method '.version_select at 0x7f7ec8a251f0>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:33.640772 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-03c31611-f739-49c1-a461-97921db6a264 tempest-TestMinimumBasicScenario-654903542 tempest-TestMinimumBasicScenario-654903542-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-618543521" status: 202 len: 0 microversion: 2.1 time: 0.022814 Aug 18 11:12:33.641347 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 463/941] 10.222.0.15 () {58 vars in 1269 bytes} [Thu Aug 18 11:12:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-618543521 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:12:35.292371 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:35.292895 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:35.300400 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:35.300918 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:35.301355 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:35.302154 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:35.302736 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:35.303191 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:35.318151 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] HTTP exception thrown: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Request method failure captured: Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: DELETE /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 HTTP/1.1 Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_h2ZlHFg0ZNbiYtbz_Dz90irfMjnd7sCsLGgtFUHuF0d-Cnpuk3h6uG08wfaZuQb4VPqgA5aVM5faXO_rlmv0GoNc0_3pJ96PnAEh0OcpIo4ptTrSWZ1w_umYr3a-mLbhYBegEYwPZELiGKpCVS3YjnqPYyh46Eqnjgq5MUMeKfN12U Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:12:35.319711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c2dd094c20324a7e8bfe6f3ea11dce38", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c2dd094c20324a7e8bfe6f3ea11dce38"}]}] Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 932e75ccffec4118b9de434cc59564f7 Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:35.321226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '829cc03a-13f5-48fd-9069-a9f21d4b9758'} Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:12:35.322015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:35.323186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:35.324360 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Returning 404 to user: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:12:35.324360 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7b282d95-a9cf-444f-aefe-7ccc1297851a tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "DELETE /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 404 len: 111 microversion: 2.1 time: 0.032759 Aug 18 11:12:35.324360 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 479/942] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:12:35 2022] DELETE /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:12:35.330999 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:35.331608 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 829cc03a-13f5-48fd-9069-a9f21d4b9758] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:35.338349 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:35.338834 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:35.339264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:35.339952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:35.340398 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:35.340817 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:35.355766 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] HTTP exception thrown: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Request method failure captured: Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 HTTP/1.1 Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_h2ZlHFg0ZNbiYtbz_Dz90irfMjnd7sCsLGgtFUHuF0d-Cnpuk3h6uG08wfaZuQb4VPqgA5aVM5faXO_rlmv0GoNc0_3pJ96PnAEh0OcpIo4ptTrSWZ1w_umYr3a-mLbhYBegEYwPZELiGKpCVS3YjnqPYyh46Eqnjgq5MUMeKfN12U Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:12:35.358356 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c2dd094c20324a7e8bfe6f3ea11dce38", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c2dd094c20324a7e8bfe6f3ea11dce38"}]}] Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 932e75ccffec4118b9de434cc59564f7 Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:35.361151 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '829cc03a-13f5-48fd-9069-a9f21d4b9758'} Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:12:35.362708 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. Aug 18 11:12:35.365279 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:35.368200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Returning 404 to user: Instance 829cc03a-13f5-48fd-9069-a9f21d4b9758 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:12:35.368200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-149b1056-63d6-4872-9552-3bca3a5734f5 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758" status: 404 len: 111 microversion: 2.1 time: 0.033258 Aug 18 11:12:35.368200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 464/943] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:35 2022] GET /compute/v2.1/servers/829cc03a-13f5-48fd-9069-a9f21d4b9758 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:12:36.505171 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:36.505781 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:36.512338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:36.513321 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:36.513804 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:36.514750 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:36.515232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:36.516103 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:36.534538 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] HTTP exception thrown: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Request method failure captured: Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: DELETE /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce HTTP/1.1 Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_h2ZlHFg0ZNbiYtbz_Dz90irfMjnd7sCsLGgtFUHuF0d-Cnpuk3h6uG08wfaZuQb4VPqgA5aVM5faXO_rlmv0GoNc0_3pJ96PnAEh0OcpIo4ptTrSWZ1w_umYr3a-mLbhYBegEYwPZELiGKpCVS3YjnqPYyh46Eqnjgq5MUMeKfN12U Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:12:36.536769 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c2dd094c20324a7e8bfe6f3ea11dce38", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c2dd094c20324a7e8bfe6f3ea11dce38"}]}] Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: 932e75ccffec4118b9de434cc59564f7 Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:12:36.538379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '4584500a-8d03-4227-ac47-c7ea8b80d2ce'} Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:12:36.539228 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:12:36.540709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:12:36.543966 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Returning 404 to user: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:12:36.545042 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-31fe33e9-fd91-4dc2-a545-08567ee16fdd tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 404 len: 111 microversion: 2.1 time: 0.043740 Aug 18 11:12:36.545864 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 480/944] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:12:36 2022] DELETE /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:12:36.558044 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:12:36.559306 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] [instance: 4584500a-8d03-4227-ac47-c7ea8b80d2ce] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:12:36.565672 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:36.567248 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:36.567898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:36.568553 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:36.569445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:12:36.571053 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:12:36.571669 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:12:36.587223 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:36.589135 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] HTTP exception thrown: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Request method failure captured: Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce HTTP/1.1 Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_h2ZlHFg0ZNbiYtbz_Dz90irfMjnd7sCsLGgtFUHuF0d-Cnpuk3h6uG08wfaZuQb4VPqgA5aVM5faXO_rlmv0GoNc0_3pJ96PnAEh0OcpIo4ptTrSWZ1w_umYr3a-mLbhYBegEYwPZELiGKpCVS3YjnqPYyh46Eqnjgq5MUMeKfN12U Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:12:36.590918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c2dd094c20324a7e8bfe6f3ea11dce38", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c2dd094c20324a7e8bfe6f3ea11dce38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c2dd094c20324a7e8bfe6f3ea11dce38"}]}] Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: c2dd094c20324a7e8bfe6f3ea11dce38 Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1272579791 Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: 932e75ccffec4118b9de434cc59564f7 Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-AttachVolumeTestJSON-1272579791-project Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:12:36.592816 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '4584500a-8d03-4227-ac47-c7ea8b80d2ce'} Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:12:36.593630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. Aug 18 11:12:36.594841 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:12:36.595889 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] Returning 404 to user: Instance 4584500a-8d03-4227-ac47-c7ea8b80d2ce could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:12:36.596873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-52aac2fa-43d9-4ddd-8b68-5626b6b925c6 tempest-AttachVolumeTestJSON-1272579791 tempest-AttachVolumeTestJSON-1272579791-project] 10.222.0.15 "GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce" status: 404 len: 111 microversion: 2.1 time: 0.041043 Aug 18 11:12:36.601049 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 465/945] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:12:36 2022] GET /compute/v2.1/servers/4584500a-8d03-4227-ac47-c7ea8b80d2ce => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:12:53.960128 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:53.961040 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:54.152103 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-80afd0e4-1229-422c-904d-10b3cb3cc9e3 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Action: 'create', calling method: .version_select at 0x7f7ec8a0da60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1576310350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCtgZGJ2NcGogVfLXI4C14zE2tpHH4i6/nM4hMkzcAd1wy/IEk/JLzJQD/bYY8cBdOCyXsLJjKQyeZtEt6ED6sT+OH4hsZinjxRuY9Xdkblxl04SANJOrxSMUh9AYDUWg=="}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:12:54.170621 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-80afd0e4-1229-422c-904d-10b3cb3cc9e3 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Getting quotas for project 4cd8f29717d84b5ebfa176b0040f5778. Resources: {'key_pairs'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:12:54.175311 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-80afd0e4-1229-422c-904d-10b3cb3cc9e3 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Getting quotas for user d4e3a8a1512c47a19cd3c23f171e24c6 and project 4cd8f29717d84b5ebfa176b0040f5778. Resources: {'key_pairs'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:12:54.200270 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-80afd0e4-1229-422c-904d-10b3cb3cc9e3 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.245227 Aug 18 11:12:54.200869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 481/946] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Aug 18 11:12:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:13:15.040888 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-256004163", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1576310350", "security_groups": [{"name": "tempest-secgroup-smoke-30560218"}], "block_device_mapping_v2": [{"uuid": "61b7256c-4a75-4bd4-966f-e7753d2b7d13", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b05b383-4bc5-4d6f-8868-dc946d4228f7"}]}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:13:15.284675 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] validate_networks() for [('2b05b383-4bc5-4d6f-8868-dc946d4228f7', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:13:15.774959 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:13:15.775390 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:13:15.775861 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:13:15.776270 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:13:15.776678 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:13:15.786588 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:15.787061 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:15.787493 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:15.788211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:15.788662 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:15.789086 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:15.806266 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Getting quotas for project 4cd8f29717d84b5ebfa176b0040f5778. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:13:15.810916 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Getting quotas for user d4e3a8a1512c47a19cd3c23f171e24c6 and project 4cd8f29717d84b5ebfa176b0040f5778. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:13:15.868776 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:13:15.871509 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61b7256c-4a75-4bd4-966f-e7753d2b7d13',volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:13:16.002000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d64015d2-b8f8-4230-a9ca-0851c4ac274a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.965122 Aug 18 11:13:16.002657 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 466/947] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:13:15 2022] POST /compute/v2.1/servers => generated 404 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:13:16.015388 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4aaba7f6-bdae-46a6-bdce-dafcd588243d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:16.016063 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4aaba7f6-bdae-46a6-bdce-dafcd588243d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:16.019598 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=4 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:16.020704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:16.132093 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4aaba7f6-bdae-46a6-bdce-dafcd588243d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:16.139106 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4aaba7f6-bdae-46a6-bdce-dafcd588243d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1094 microversion: 2.1 time: 0.127717 Aug 18 11:13:16.139663 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 482/948] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:16 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1094 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:17.161479 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a5e8b19c-afc8-4200-bdac-63f587beeeed tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:17.162381 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a5e8b19c-afc8-4200-bdac-63f587beeeed tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:17.171195 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5e8b19c-afc8-4200-bdac-63f587beeeed tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:17.172074 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5e8b19c-afc8-4200-bdac-63f587beeeed tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:17.172607 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5e8b19c-afc8-4200-bdac-63f587beeeed tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:17.173388 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5e8b19c-afc8-4200-bdac-63f587beeeed tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:17.174753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5e8b19c-afc8-4200-bdac-63f587beeeed tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:17.174753 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5e8b19c-afc8-4200-bdac-63f587beeeed tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:17.249716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a5e8b19c-afc8-4200-bdac-63f587beeeed tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:17.258419 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a5e8b19c-afc8-4200-bdac-63f587beeeed tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1210 microversion: 2.1 time: 0.102222 Aug 18 11:13:17.259397 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 467/949] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:17 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:18.279606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c91c0fb3-8d1c-4809-8a89-dd8619dfbfc0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:18.280860 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c91c0fb3-8d1c-4809-8a89-dd8619dfbfc0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:18.287419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c91c0fb3-8d1c-4809-8a89-dd8619dfbfc0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:18.287903 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c91c0fb3-8d1c-4809-8a89-dd8619dfbfc0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:18.288329 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c91c0fb3-8d1c-4809-8a89-dd8619dfbfc0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:18.289034 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c91c0fb3-8d1c-4809-8a89-dd8619dfbfc0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:18.289484 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c91c0fb3-8d1c-4809-8a89-dd8619dfbfc0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:18.289933 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c91c0fb3-8d1c-4809-8a89-dd8619dfbfc0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:18.428893 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c91c0fb3-8d1c-4809-8a89-dd8619dfbfc0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:18.441715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c91c0fb3-8d1c-4809-8a89-dd8619dfbfc0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.165951 Aug 18 11:13:18.442301 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 483/950] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:18 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:19.061496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-fb0b5926-6ad5-4479-9e92-a3ee63433841 req-b5d3bf5e-f8a7-47ef-bac1-7ae0242766e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb72685-d575-48ff-b600-bd170ababcc6", "tag": "5da87f89-c818-40e2-8e37-bd667f9561bf"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:13:19.071524 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-fb0b5926-6ad5-4479-9e92-a3ee63433841 req-b5d3bf5e-f8a7-47ef-bac1-7ae0242766e7 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:19.072239 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-fb0b5926-6ad5-4479-9e92-a3ee63433841 req-b5d3bf5e-f8a7-47ef-bac1-7ae0242766e7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:19.072797 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-fb0b5926-6ad5-4479-9e92-a3ee63433841 req-b5d3bf5e-f8a7-47ef-bac1-7ae0242766e7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:19.084070 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-fb0b5926-6ad5-4479-9e92-a3ee63433841 req-b5d3bf5e-f8a7-47ef-bac1-7ae0242766e7 service nova] Creating event network-changed:5da87f89-c818-40e2-8e37-bd667f9561bf for instance 2cb72685-d575-48ff-b600-bd170ababcc6 on hv-cinder-82660 Aug 18 11:13:19.089029 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-fb0b5926-6ad5-4479-9e92-a3ee63433841 req-b5d3bf5e-f8a7-47ef-bac1-7ae0242766e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191552 Aug 18 11:13:19.090248 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 468/951] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:13:19.462844 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1d82553a-adf9-484f-b118-3f884df84776 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:19.463448 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1d82553a-adf9-484f-b118-3f884df84776 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:19.469845 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1d82553a-adf9-484f-b118-3f884df84776 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:19.470325 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1d82553a-adf9-484f-b118-3f884df84776 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:19.470754 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1d82553a-adf9-484f-b118-3f884df84776 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:19.471647 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1d82553a-adf9-484f-b118-3f884df84776 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:19.472098 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1d82553a-adf9-484f-b118-3f884df84776 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:19.472518 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1d82553a-adf9-484f-b118-3f884df84776 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:19.612591 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1d82553a-adf9-484f-b118-3f884df84776 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:19.621408 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1d82553a-adf9-484f-b118-3f884df84776 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.161675 Aug 18 11:13:19.622595 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 484/952] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:19 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:20.643167 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-70300e58-ee98-43cd-b1cc-8830ef87ab00 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:20.643865 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-70300e58-ee98-43cd-b1cc-8830ef87ab00 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:20.650093 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-70300e58-ee98-43cd-b1cc-8830ef87ab00 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:20.650576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-70300e58-ee98-43cd-b1cc-8830ef87ab00 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:20.651015 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-70300e58-ee98-43cd-b1cc-8830ef87ab00 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:20.651707 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-70300e58-ee98-43cd-b1cc-8830ef87ab00 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:20.652695 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-70300e58-ee98-43cd-b1cc-8830ef87ab00 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:20.653319 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-70300e58-ee98-43cd-b1cc-8830ef87ab00 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:20.788876 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-70300e58-ee98-43cd-b1cc-8830ef87ab00 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:20.797445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-70300e58-ee98-43cd-b1cc-8830ef87ab00 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.159037 Aug 18 11:13:20.798048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 469/953] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:20 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:21.818684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-4ebf76b7-c7da-415c-9830-863854840891 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:21.819297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-4ebf76b7-c7da-415c-9830-863854840891 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:21.826097 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4ebf76b7-c7da-415c-9830-863854840891 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:21.826589 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4ebf76b7-c7da-415c-9830-863854840891 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:21.827058 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4ebf76b7-c7da-415c-9830-863854840891 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:21.827758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4ebf76b7-c7da-415c-9830-863854840891 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:21.828216 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4ebf76b7-c7da-415c-9830-863854840891 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:21.828642 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-4ebf76b7-c7da-415c-9830-863854840891 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:21.971279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-4ebf76b7-c7da-415c-9830-863854840891 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:21.978890 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-4ebf76b7-c7da-415c-9830-863854840891 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.164078 Aug 18 11:13:21.979447 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 485/954] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:21 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:23.000140 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1498f3e3-d625-4dd2-b1cd-58817c834af0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:23.000745 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1498f3e3-d625-4dd2-b1cd-58817c834af0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:23.008092 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1498f3e3-d625-4dd2-b1cd-58817c834af0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:23.008576 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1498f3e3-d625-4dd2-b1cd-58817c834af0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:23.009007 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1498f3e3-d625-4dd2-b1cd-58817c834af0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:23.009735 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1498f3e3-d625-4dd2-b1cd-58817c834af0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:23.010185 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1498f3e3-d625-4dd2-b1cd-58817c834af0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:23.010606 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-1498f3e3-d625-4dd2-b1cd-58817c834af0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:23.145878 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1498f3e3-d625-4dd2-b1cd-58817c834af0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:23.153382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1498f3e3-d625-4dd2-b1cd-58817c834af0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.157112 Aug 18 11:13:23.153966 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 470/955] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:22 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:24.175094 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c46be7e5-cd3e-42fd-8cb4-5a0b3a085382 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:24.175620 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c46be7e5-cd3e-42fd-8cb4-5a0b3a085382 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:24.182103 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c46be7e5-cd3e-42fd-8cb4-5a0b3a085382 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:24.183492 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c46be7e5-cd3e-42fd-8cb4-5a0b3a085382 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:24.183970 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c46be7e5-cd3e-42fd-8cb4-5a0b3a085382 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:24.184684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c46be7e5-cd3e-42fd-8cb4-5a0b3a085382 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:24.185134 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c46be7e5-cd3e-42fd-8cb4-5a0b3a085382 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:24.185575 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c46be7e5-cd3e-42fd-8cb4-5a0b3a085382 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:24.319700 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c46be7e5-cd3e-42fd-8cb4-5a0b3a085382 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:24.327835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c46be7e5-cd3e-42fd-8cb4-5a0b3a085382 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.157316 Aug 18 11:13:24.328393 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 486/956] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:24 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:25.348419 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-fde30e4b-99f3-49c9-8724-2335321c8920 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:25.349018 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-fde30e4b-99f3-49c9-8724-2335321c8920 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:25.356204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fde30e4b-99f3-49c9-8724-2335321c8920 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:25.356679 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fde30e4b-99f3-49c9-8724-2335321c8920 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:25.357109 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fde30e4b-99f3-49c9-8724-2335321c8920 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:25.357824 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fde30e4b-99f3-49c9-8724-2335321c8920 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:25.358273 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fde30e4b-99f3-49c9-8724-2335321c8920 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:25.358697 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-fde30e4b-99f3-49c9-8724-2335321c8920 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:25.491769 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-fde30e4b-99f3-49c9-8724-2335321c8920 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:25.500474 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-fde30e4b-99f3-49c9-8724-2335321c8920 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.156015 Aug 18 11:13:25.501053 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 471/957] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:25 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:26.521884 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5444e239-f238-4eb2-9312-565c2b60e95e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:26.522570 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5444e239-f238-4eb2-9312-565c2b60e95e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:26.525100 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:26.530882 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5444e239-f238-4eb2-9312-565c2b60e95e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:26.531369 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5444e239-f238-4eb2-9312-565c2b60e95e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:26.531832 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5444e239-f238-4eb2-9312-565c2b60e95e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:26.532526 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5444e239-f238-4eb2-9312-565c2b60e95e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:26.532975 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5444e239-f238-4eb2-9312-565c2b60e95e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:26.533391 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5444e239-f238-4eb2-9312-565c2b60e95e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:26.670298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5444e239-f238-4eb2-9312-565c2b60e95e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:26.678143 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5444e239-f238-4eb2-9312-565c2b60e95e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.160522 Aug 18 11:13:26.678713 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 487/958] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:26 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:27.700455 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6bc2c28f-940f-4414-9a1c-6551ee6139dc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:27.700999 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6bc2c28f-940f-4414-9a1c-6551ee6139dc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:27.702898 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:27.703556 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=6 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:27.709674 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6bc2c28f-940f-4414-9a1c-6551ee6139dc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:27.710150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6bc2c28f-940f-4414-9a1c-6551ee6139dc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:27.710581 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6bc2c28f-940f-4414-9a1c-6551ee6139dc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:27.711267 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6bc2c28f-940f-4414-9a1c-6551ee6139dc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:27.711711 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6bc2c28f-940f-4414-9a1c-6551ee6139dc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:27.712129 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6bc2c28f-940f-4414-9a1c-6551ee6139dc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:27.845665 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6bc2c28f-940f-4414-9a1c-6551ee6139dc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:27.853826 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6bc2c28f-940f-4414-9a1c-6551ee6139dc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.157861 Aug 18 11:13:27.854401 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 472/959] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:27 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:28.875508 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7365b356-a577-4b14-8ecd-744f3796855c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:28.876082 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7365b356-a577-4b14-8ecd-744f3796855c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:28.882116 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7365b356-a577-4b14-8ecd-744f3796855c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:28.882606 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7365b356-a577-4b14-8ecd-744f3796855c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:28.883044 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7365b356-a577-4b14-8ecd-744f3796855c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:28.883736 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7365b356-a577-4b14-8ecd-744f3796855c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:28.884192 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7365b356-a577-4b14-8ecd-744f3796855c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:28.884617 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7365b356-a577-4b14-8ecd-744f3796855c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:29.025046 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7365b356-a577-4b14-8ecd-744f3796855c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:29.033316 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7365b356-a577-4b14-8ecd-744f3796855c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.161940 Aug 18 11:13:29.033910 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 488/960] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:28 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:30.053868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8c9ca8c6-193e-4a23-9b51-c0bde552d2a6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:30.054450 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8c9ca8c6-193e-4a23-9b51-c0bde552d2a6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:30.061541 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8c9ca8c6-193e-4a23-9b51-c0bde552d2a6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:30.062030 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8c9ca8c6-193e-4a23-9b51-c0bde552d2a6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:30.062470 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8c9ca8c6-193e-4a23-9b51-c0bde552d2a6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:30.063160 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8c9ca8c6-193e-4a23-9b51-c0bde552d2a6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:30.063618 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8c9ca8c6-193e-4a23-9b51-c0bde552d2a6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:30.064041 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8c9ca8c6-193e-4a23-9b51-c0bde552d2a6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:30.194029 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-8c9ca8c6-193e-4a23-9b51-c0bde552d2a6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:30.201982 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8c9ca8c6-193e-4a23-9b51-c0bde552d2a6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.152000 Aug 18 11:13:30.202553 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 473/961] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:30 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:30.703238 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-cd332839-f2f0-4fae-8527-3820d283b004 req-9fb6ad01-d0d7-4e65-b1d4-a2cf4573d50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb72685-d575-48ff-b600-bd170ababcc6", "name": "network-vif-plugged", "status": "completed", "tag": "5da87f89-c818-40e2-8e37-bd667f9561bf"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:13:30.712879 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-cd332839-f2f0-4fae-8527-3820d283b004 req-9fb6ad01-d0d7-4e65-b1d4-a2cf4573d50a service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:30.713374 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-cd332839-f2f0-4fae-8527-3820d283b004 req-9fb6ad01-d0d7-4e65-b1d4-a2cf4573d50a service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:30.714405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-cd332839-f2f0-4fae-8527-3820d283b004 req-9fb6ad01-d0d7-4e65-b1d4-a2cf4573d50a service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:30.726413 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-cd332839-f2f0-4fae-8527-3820d283b004 req-9fb6ad01-d0d7-4e65-b1d4-a2cf4573d50a service nova] Creating event network-vif-plugged:5da87f89-c818-40e2-8e37-bd667f9561bf for instance 2cb72685-d575-48ff-b600-bd170ababcc6 on hv-cinder-82660 Aug 18 11:13:30.731906 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-cd332839-f2f0-4fae-8527-3820d283b004 req-9fb6ad01-d0d7-4e65-b1d4-a2cf4573d50a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170624 Aug 18 11:13:30.732471 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 489/962] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:13:31.223585 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0824d825-763b-4bb6-b85b-a71e3f8097f9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:31.224188 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0824d825-763b-4bb6-b85b-a71e3f8097f9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:31.231417 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0824d825-763b-4bb6-b85b-a71e3f8097f9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:31.231896 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0824d825-763b-4bb6-b85b-a71e3f8097f9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:31.232327 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0824d825-763b-4bb6-b85b-a71e3f8097f9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:31.233088 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0824d825-763b-4bb6-b85b-a71e3f8097f9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:31.233852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0824d825-763b-4bb6-b85b-a71e3f8097f9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:31.234037 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0824d825-763b-4bb6-b85b-a71e3f8097f9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:31.369572 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0824d825-763b-4bb6-b85b-a71e3f8097f9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:31.378329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0824d825-763b-4bb6-b85b-a71e3f8097f9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1264 microversion: 2.1 time: 0.158803 Aug 18 11:13:31.379000 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 474/963] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:31 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:13:32.401823 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-cc0dd57c-7c14-4c97-897d-69c3fc30ed87 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:32.402630 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-cc0dd57c-7c14-4c97-897d-69c3fc30ed87 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:32.409111 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cc0dd57c-7c14-4c97-897d-69c3fc30ed87 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:32.409748 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cc0dd57c-7c14-4c97-897d-69c3fc30ed87 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:32.410193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cc0dd57c-7c14-4c97-897d-69c3fc30ed87 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:32.410985 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cc0dd57c-7c14-4c97-897d-69c3fc30ed87 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:32.411448 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cc0dd57c-7c14-4c97-897d-69c3fc30ed87 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:32.411871 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-cc0dd57c-7c14-4c97-897d-69c3fc30ed87 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:32.559600 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-cc0dd57c-7c14-4c97-897d-69c3fc30ed87 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:32.567221 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-cc0dd57c-7c14-4c97-897d-69c3fc30ed87 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1451 microversion: 2.1 time: 0.170743 Aug 18 11:13:32.567779 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 490/964] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:32 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:13:32.587516 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-2997bf2c-65ff-4f2b-8557-f2379b92cc72 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:13:32.588123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-2997bf2c-65ff-4f2b-8557-f2379b92cc72 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:13:32.595563 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2997bf2c-65ff-4f2b-8557-f2379b92cc72 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:32.596048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2997bf2c-65ff-4f2b-8557-f2379b92cc72 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:32.596488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2997bf2c-65ff-4f2b-8557-f2379b92cc72 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:32.597177 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2997bf2c-65ff-4f2b-8557-f2379b92cc72 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:32.597663 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2997bf2c-65ff-4f2b-8557-f2379b92cc72 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:32.598097 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-2997bf2c-65ff-4f2b-8557-f2379b92cc72 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:32.733574 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-2997bf2c-65ff-4f2b-8557-f2379b92cc72 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:13:32.741075 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-2997bf2c-65ff-4f2b-8557-f2379b92cc72 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1451 microversion: 2.1 time: 0.157379 Aug 18 11:13:32.741654 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 475/965] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:13:32 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:13:34.827684 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-4c0c9584-6afe-4318-b942-4e5bb61556fc req-836b2868-1e33-456d-868d-9264d1bc42e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb72685-d575-48ff-b600-bd170ababcc6", "tag": "5da87f89-c818-40e2-8e37-bd667f9561bf"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:13:34.839332 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-4c0c9584-6afe-4318-b942-4e5bb61556fc req-836b2868-1e33-456d-868d-9264d1bc42e4 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:13:34.839806 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-4c0c9584-6afe-4318-b942-4e5bb61556fc req-836b2868-1e33-456d-868d-9264d1bc42e4 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:13:34.840231 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-4c0c9584-6afe-4318-b942-4e5bb61556fc req-836b2868-1e33-456d-868d-9264d1bc42e4 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:13:34.852937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-4c0c9584-6afe-4318-b942-4e5bb61556fc req-836b2868-1e33-456d-868d-9264d1bc42e4 service nova] Creating event network-changed:5da87f89-c818-40e2-8e37-bd667f9561bf for instance 2cb72685-d575-48ff-b600-bd170ababcc6 on hv-cinder-82660 Aug 18 11:13:34.859615 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-4c0c9584-6afe-4318-b942-4e5bb61556fc req-836b2868-1e33-456d-868d-9264d1bc42e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036000 Aug 18 11:13:34.860340 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 491/966] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:14:09.759714 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1969652363", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "networks": [{"uuid": "a5b79be7-2ee5-40b2-a19e-7d09068762d4"}]}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:14:09.769107 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:09.769987 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=53 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:09.817804 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] validate_networks() for [('a5b79be7-2ee5-40b2-a19e-7d09068762d4', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:14:10.184930 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:14:10.185382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:14:10.185887 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:14:10.186292 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:14:10.186856 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:14:10.195538 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:10.195949 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:10.196382 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:10.197100 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:10.197570 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:10.197996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:10.217133 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Getting quotas for project dcfe3f8963494889a66d9264dc7d50cc. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:14:10.221230 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Getting quotas for user a534cf41cb884baea52d1021d2789e8f and project dcfe3f8963494889a66d9264dc7d50cc. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:14:10.232048 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:14:10.234344 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:14:10.279317 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7093b1b4-b090-40b6-a2e3-48c3b3e50312 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523695 Aug 18 11:14:10.280050 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 476/967] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:14:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:14:10.292556 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c6e02461-79b3-4ef3-b9fa-419735f0a831 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:10.293277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c6e02461-79b3-4ef3-b9fa-419735f0a831 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:10.295937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=22 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:10.297149 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=46 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:10.358431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-c6e02461-79b3-4ef3-b9fa-419735f0a831 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:10.365411 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c6e02461-79b3-4ef3-b9fa-419735f0a831 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1219 microversion: 2.1 time: 0.077842 Aug 18 11:14:10.366025 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 492/968] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:10 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:11.388716 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7a11cb2a-1df9-4923-91da-d8e4798cdd72 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:11.389535 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7a11cb2a-1df9-4923-91da-d8e4798cdd72 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:11.442135 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7a11cb2a-1df9-4923-91da-d8e4798cdd72 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:11.449460 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7a11cb2a-1df9-4923-91da-d8e4798cdd72 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1219 microversion: 2.1 time: 0.066032 Aug 18 11:14:11.450629 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 477/969] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:11 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:12.472719 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-45cf7b32-a5ed-4ae6-8265-decd03b12fab tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:12.473416 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-45cf7b32-a5ed-4ae6-8265-decd03b12fab tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:12.530531 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-45cf7b32-a5ed-4ae6-8265-decd03b12fab tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:12.537780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-45cf7b32-a5ed-4ae6-8265-decd03b12fab tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1219 microversion: 2.1 time: 0.069542 Aug 18 11:14:12.538335 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 493/970] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:12 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:13.561181 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d7135b66-da0c-41d2-b3a5-54706b00965c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:13.561914 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d7135b66-da0c-41d2-b3a5-54706b00965c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:13.617638 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d7135b66-da0c-41d2-b3a5-54706b00965c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:13.625602 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d7135b66-da0c-41d2-b3a5-54706b00965c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1219 microversion: 2.1 time: 0.069197 Aug 18 11:14:13.626330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 478/971] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:13 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:14.646956 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-997a1b9d-9bc2-4bd9-a32b-854c32ed2f5b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:14.647691 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-997a1b9d-9bc2-4bd9-a32b-854c32ed2f5b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:14.655366 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-997a1b9d-9bc2-4bd9-a32b-854c32ed2f5b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:14.655936 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-997a1b9d-9bc2-4bd9-a32b-854c32ed2f5b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:14.656453 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-997a1b9d-9bc2-4bd9-a32b-854c32ed2f5b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:14.657172 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-997a1b9d-9bc2-4bd9-a32b-854c32ed2f5b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:14.657657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-997a1b9d-9bc2-4bd9-a32b-854c32ed2f5b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:14.658088 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-997a1b9d-9bc2-4bd9-a32b-854c32ed2f5b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:14.724839 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-997a1b9d-9bc2-4bd9-a32b-854c32ed2f5b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:14.732583 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-997a1b9d-9bc2-4bd9-a32b-854c32ed2f5b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1277 microversion: 2.1 time: 0.089437 Aug 18 11:14:14.733076 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 494/972] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:14 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:15.509201 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-338260a2-ef53-4b6c-8e40-6b9aa010e8fa req-234d5ff2-0b90-4aed-9072-1afc89891f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73be4b02-3890-46eb-a65c-d1fcdc999c97", "tag": "9db1286b-e734-41a3-ac5c-b95dba0faf80"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:14:15.521702 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-338260a2-ef53-4b6c-8e40-6b9aa010e8fa req-234d5ff2-0b90-4aed-9072-1afc89891f5b service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:15.529024 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-338260a2-ef53-4b6c-8e40-6b9aa010e8fa req-234d5ff2-0b90-4aed-9072-1afc89891f5b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:15.533852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-338260a2-ef53-4b6c-8e40-6b9aa010e8fa req-234d5ff2-0b90-4aed-9072-1afc89891f5b service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:15.546778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-338260a2-ef53-4b6c-8e40-6b9aa010e8fa req-234d5ff2-0b90-4aed-9072-1afc89891f5b service nova] Creating event network-changed:9db1286b-e734-41a3-ac5c-b95dba0faf80 for instance 73be4b02-3890-46eb-a65c-d1fcdc999c97 on hv-cinder-82660 Aug 18 11:14:15.552271 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-338260a2-ef53-4b6c-8e40-6b9aa010e8fa req-234d5ff2-0b90-4aed-9072-1afc89891f5b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046891 Aug 18 11:14:15.552971 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 479/973] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:14:15.753865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5d5b58c4-980a-49e1-85c6-33c01219e047 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:15.754476 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5d5b58c4-980a-49e1-85c6-33c01219e047 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:15.760767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d5b58c4-980a-49e1-85c6-33c01219e047 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:15.761246 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d5b58c4-980a-49e1-85c6-33c01219e047 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:15.761714 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d5b58c4-980a-49e1-85c6-33c01219e047 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:15.763168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d5b58c4-980a-49e1-85c6-33c01219e047 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:15.763619 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d5b58c4-980a-49e1-85c6-33c01219e047 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:15.764038 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5d5b58c4-980a-49e1-85c6-33c01219e047 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:15.913271 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5d5b58c4-980a-49e1-85c6-33c01219e047 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:15.921723 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5d5b58c4-980a-49e1-85c6-33c01219e047 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1319 microversion: 2.1 time: 0.171321 Aug 18 11:14:15.922295 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 495/974] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:15 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:14:16.943340 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-c01cb75d-93e7-418a-8fec-a4b7aa9f2dfe tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:16.943964 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-c01cb75d-93e7-418a-8fec-a4b7aa9f2dfe tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:16.951227 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c01cb75d-93e7-418a-8fec-a4b7aa9f2dfe tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:16.951728 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c01cb75d-93e7-418a-8fec-a4b7aa9f2dfe tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:16.952200 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c01cb75d-93e7-418a-8fec-a4b7aa9f2dfe tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:16.952922 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c01cb75d-93e7-418a-8fec-a4b7aa9f2dfe tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:16.953383 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c01cb75d-93e7-418a-8fec-a4b7aa9f2dfe tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:16.953850 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-c01cb75d-93e7-418a-8fec-a4b7aa9f2dfe tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:17.260258 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-c01cb75d-93e7-418a-8fec-a4b7aa9f2dfe tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:17.268502 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-c01cb75d-93e7-418a-8fec-a4b7aa9f2dfe tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1319 microversion: 2.1 time: 0.329962 Aug 18 11:14:17.269079 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 480/975] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:16 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:18.290756 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-bf9909ff-ff49-45a6-b19e-59707b7580b4 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:18.291367 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-bf9909ff-ff49-45a6-b19e-59707b7580b4 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:18.298542 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bf9909ff-ff49-45a6-b19e-59707b7580b4 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:18.299030 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bf9909ff-ff49-45a6-b19e-59707b7580b4 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:18.299493 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bf9909ff-ff49-45a6-b19e-59707b7580b4 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:18.300144 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bf9909ff-ff49-45a6-b19e-59707b7580b4 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:18.300597 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bf9909ff-ff49-45a6-b19e-59707b7580b4 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:18.301016 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-bf9909ff-ff49-45a6-b19e-59707b7580b4 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:18.430146 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-bf9909ff-ff49-45a6-b19e-59707b7580b4 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:18.438555 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-bf9909ff-ff49-45a6-b19e-59707b7580b4 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1319 microversion: 2.1 time: 0.151684 Aug 18 11:14:18.439123 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 496/976] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:18 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:19.460329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5b09deb5-7c98-4aa2-8ffd-1216e64e3c61 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:19.460855 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5b09deb5-7c98-4aa2-8ffd-1216e64e3c61 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:19.467503 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b09deb5-7c98-4aa2-8ffd-1216e64e3c61 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:19.467988 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b09deb5-7c98-4aa2-8ffd-1216e64e3c61 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:19.468423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b09deb5-7c98-4aa2-8ffd-1216e64e3c61 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:19.469112 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b09deb5-7c98-4aa2-8ffd-1216e64e3c61 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:19.469603 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b09deb5-7c98-4aa2-8ffd-1216e64e3c61 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:19.470034 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5b09deb5-7c98-4aa2-8ffd-1216e64e3c61 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:19.607544 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5b09deb5-7c98-4aa2-8ffd-1216e64e3c61 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:19.615032 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5b09deb5-7c98-4aa2-8ffd-1216e64e3c61 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1319 microversion: 2.1 time: 0.158672 Aug 18 11:14:19.615599 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 481/977] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:19 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:20.636100 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d6f92a79-e322-440f-8b0d-3da41a3eefb1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:20.636878 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d6f92a79-e322-440f-8b0d-3da41a3eefb1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:20.644210 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6f92a79-e322-440f-8b0d-3da41a3eefb1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:20.644730 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6f92a79-e322-440f-8b0d-3da41a3eefb1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:20.645194 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6f92a79-e322-440f-8b0d-3da41a3eefb1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:20.645941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6f92a79-e322-440f-8b0d-3da41a3eefb1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:20.646401 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6f92a79-e322-440f-8b0d-3da41a3eefb1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:20.646826 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d6f92a79-e322-440f-8b0d-3da41a3eefb1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:20.781274 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-d6f92a79-e322-440f-8b0d-3da41a3eefb1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:20.788894 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-d6f92a79-e322-440f-8b0d-3da41a3eefb1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1319 microversion: 2.1 time: 0.156728 Aug 18 11:14:20.789681 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 497/978] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:20 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:20.909915 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-376099ba-fa16-4819-a0e3-2ea64f07d632 req-5cb26dc9-af16-4d27-811d-fefec6ea6a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73be4b02-3890-46eb-a65c-d1fcdc999c97", "name": "network-vif-plugged", "status": "completed", "tag": "9db1286b-e734-41a3-ac5c-b95dba0faf80"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:14:20.915992 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:20.925634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-376099ba-fa16-4819-a0e3-2ea64f07d632 req-5cb26dc9-af16-4d27-811d-fefec6ea6a96 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:20.926117 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-376099ba-fa16-4819-a0e3-2ea64f07d632 req-5cb26dc9-af16-4d27-811d-fefec6ea6a96 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:20.926547 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-376099ba-fa16-4819-a0e3-2ea64f07d632 req-5cb26dc9-af16-4d27-811d-fefec6ea6a96 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:20.941602 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-376099ba-fa16-4819-a0e3-2ea64f07d632 req-5cb26dc9-af16-4d27-811d-fefec6ea6a96 service nova] Creating event network-vif-plugged:9db1286b-e734-41a3-ac5c-b95dba0faf80 for instance 73be4b02-3890-46eb-a65c-d1fcdc999c97 on hv-cinder-82660 Aug 18 11:14:20.949026 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-376099ba-fa16-4819-a0e3-2ea64f07d632 req-5cb26dc9-af16-4d27-811d-fefec6ea6a96 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042587 Aug 18 11:14:20.950024 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 482/979] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:14:21.811434 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a81dccbf-ca5f-424b-ba32-dcc1b63e78d8 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:21.812190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a81dccbf-ca5f-424b-ba32-dcc1b63e78d8 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:21.818656 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a81dccbf-ca5f-424b-ba32-dcc1b63e78d8 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:21.819137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a81dccbf-ca5f-424b-ba32-dcc1b63e78d8 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:21.819562 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a81dccbf-ca5f-424b-ba32-dcc1b63e78d8 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:21.820248 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a81dccbf-ca5f-424b-ba32-dcc1b63e78d8 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:21.820696 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a81dccbf-ca5f-424b-ba32-dcc1b63e78d8 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:21.821116 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a81dccbf-ca5f-424b-ba32-dcc1b63e78d8 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:21.955457 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a81dccbf-ca5f-424b-ba32-dcc1b63e78d8 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:21.962898 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a81dccbf-ca5f-424b-ba32-dcc1b63e78d8 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1319 microversion: 2.1 time: 0.155311 Aug 18 11:14:21.963476 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 498/980] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:21 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:22.986510 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7c037acb-95dc-4787-9391-967ecdc36e1b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:22.987117 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7c037acb-95dc-4787-9391-967ecdc36e1b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:22.993277 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7c037acb-95dc-4787-9391-967ecdc36e1b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:22.993795 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7c037acb-95dc-4787-9391-967ecdc36e1b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:22.994233 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7c037acb-95dc-4787-9391-967ecdc36e1b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:22.994927 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7c037acb-95dc-4787-9391-967ecdc36e1b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:22.995384 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7c037acb-95dc-4787-9391-967ecdc36e1b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:22.995806 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7c037acb-95dc-4787-9391-967ecdc36e1b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:23.126661 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7c037acb-95dc-4787-9391-967ecdc36e1b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:23.134518 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7c037acb-95dc-4787-9391-967ecdc36e1b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1509 microversion: 2.1 time: 0.153948 Aug 18 11:14:23.135097 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 483/981] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:22 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:14:36.854548 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:14:36.855167 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Thu Aug 18 11:14:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:14:38.343665 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-48868243-186a-40e2-8e14-c7e45b36afb3 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d63cfa0c-e2f0-4eb1-8c82-43d3f97bb758", "device": "/dev/sdb"}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:14:38.346532 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-48868243-186a-40e2-8e14-c7e45b36afb3 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:38.348425 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=4 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:38.349206 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=18 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:38.349920 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=30 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:38.356225 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-48868243-186a-40e2-8e14-c7e45b36afb3 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:38.356711 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-48868243-186a-40e2-8e14-c7e45b36afb3 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:38.357148 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-48868243-186a-40e2-8e14-c7e45b36afb3 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:38.357906 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-48868243-186a-40e2-8e14-c7e45b36afb3 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:38.358364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-48868243-186a-40e2-8e14-c7e45b36afb3 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:38.358790 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-48868243-186a-40e2-8e14-c7e45b36afb3 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:38.598508 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-48868243-186a-40e2-8e14-c7e45b36afb3 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "POST /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259407 Aug 18 11:14:38.599382 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 499/982] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:14:38 2022] POST /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:14:58.212862 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-3b076bb4-5d2b-4c3e-bc5a-14d9a979a094 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:58.213366 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-3b076bb4-5d2b-4c3e-bc5a-14d9a979a094 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:58.215320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=10 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:58.216090 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:58.217336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=24 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:58.224607 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b076bb4-5d2b-4c3e-bc5a-14d9a979a094 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:58.225095 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b076bb4-5d2b-4c3e-bc5a-14d9a979a094 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:58.225697 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b076bb4-5d2b-4c3e-bc5a-14d9a979a094 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:58.226400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b076bb4-5d2b-4c3e-bc5a-14d9a979a094 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:58.226850 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b076bb4-5d2b-4c3e-bc5a-14d9a979a094 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:58.227440 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-3b076bb4-5d2b-4c3e-bc5a-14d9a979a094 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:58.316918 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-3b076bb4-5d2b-4c3e-bc5a-14d9a979a094 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lazy-loading 'services' on Instance uuid 73be4b02-3890-46eb-a65c-d1fcdc999c97 {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:14:58.391784 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-3b076bb4-5d2b-4c3e-bc5a-14d9a979a094 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "DELETE /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97/os-volume_attachments/d63cfa0c-e2f0-4eb1-8c82-43d3f97bb758" status: 202 len: 0 microversion: 2.1 time: 0.182768 Aug 18 11:14:58.392393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 484/983] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:14:58 2022] DELETE /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97/os-volume_attachments/d63cfa0c-e2f0-4eb1-8c82-43d3f97bb758 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:14:59.515232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:59.515993 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:59.520207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-0a7cf6e2-8686-48bc-b658-708772b5087f tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:59.520784 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0a7cf6e2-8686-48bc-b658-708772b5087f tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:59.528271 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0a7cf6e2-8686-48bc-b658-708772b5087f tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:59.528746 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0a7cf6e2-8686-48bc-b658-708772b5087f tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:59.529833 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0a7cf6e2-8686-48bc-b658-708772b5087f tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:59.530523 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0a7cf6e2-8686-48bc-b658-708772b5087f tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:59.530968 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0a7cf6e2-8686-48bc-b658-708772b5087f tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:59.531390 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-0a7cf6e2-8686-48bc-b658-708772b5087f tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:59.556587 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-0a7cf6e2-8686-48bc-b658-708772b5087f tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Going to try to terminate instance {{(pid=120800) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:14:59.634952 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-0a7cf6e2-8686-48bc-b658-708772b5087f tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "DELETE /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 204 len: 0 microversion: 2.1 time: 0.121310 Aug 18 11:14:59.635624 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 500/984] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:14:59 2022] DELETE /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:14:59.645733 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-dd3ac1c2-07e2-45b3-9915-4297492866bd tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:59.646426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-dd3ac1c2-07e2-45b3-9915-4297492866bd tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:14:59.652598 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd3ac1c2-07e2-45b3-9915-4297492866bd tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:59.653120 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd3ac1c2-07e2-45b3-9915-4297492866bd tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:59.653578 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd3ac1c2-07e2-45b3-9915-4297492866bd tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:59.655172 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd3ac1c2-07e2-45b3-9915-4297492866bd tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:59.655590 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd3ac1c2-07e2-45b3-9915-4297492866bd tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:59.656019 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-dd3ac1c2-07e2-45b3-9915-4297492866bd tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:59.788153 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-dd3ac1c2-07e2-45b3-9915-4297492866bd tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:14:59.796378 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-dd3ac1c2-07e2-45b3-9915-4297492866bd tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1515 microversion: 2.1 time: 0.155419 Aug 18 11:14:59.796981 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 485/985] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:14:59 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:00.817224 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-35acab79-6987-4081-93c4-f3c590bfabb0 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:00.817981 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-35acab79-6987-4081-93c4-f3c590bfabb0 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:00.824339 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-35acab79-6987-4081-93c4-f3c590bfabb0 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:00.824828 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-35acab79-6987-4081-93c4-f3c590bfabb0 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:00.825277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-35acab79-6987-4081-93c4-f3c590bfabb0 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:00.826989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-35acab79-6987-4081-93c4-f3c590bfabb0 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:00.827467 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-35acab79-6987-4081-93c4-f3c590bfabb0 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:00.827898 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-35acab79-6987-4081-93c4-f3c590bfabb0 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:00.966185 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-35acab79-6987-4081-93c4-f3c590bfabb0 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:00.974774 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-35acab79-6987-4081-93c4-f3c590bfabb0 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1515 microversion: 2.1 time: 0.161726 Aug 18 11:15:00.975398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 501/986] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:00 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:01.783798 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-af8025e2-6b59-48ca-8e40-6d1447447eb3 req-dd913bc9-1d2f-4374-8459-538def1467ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73be4b02-3890-46eb-a65c-d1fcdc999c97", "name": "network-vif-deleted", "tag": "9db1286b-e734-41a3-ac5c-b95dba0faf80"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:01.799138 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-af8025e2-6b59-48ca-8e40-6d1447447eb3 req-dd913bc9-1d2f-4374-8459-538def1467ea service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:01.799628 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-af8025e2-6b59-48ca-8e40-6d1447447eb3 req-dd913bc9-1d2f-4374-8459-538def1467ea service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:01.800058 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-af8025e2-6b59-48ca-8e40-6d1447447eb3 req-dd913bc9-1d2f-4374-8459-538def1467ea service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:01.818365 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-af8025e2-6b59-48ca-8e40-6d1447447eb3 req-dd913bc9-1d2f-4374-8459-538def1467ea service nova] Creating event network-vif-deleted:9db1286b-e734-41a3-ac5c-b95dba0faf80 for instance 73be4b02-3890-46eb-a65c-d1fcdc999c97 on hv-cinder-82660 Aug 18 11:15:01.823905 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-af8025e2-6b59-48ca-8e40-6d1447447eb3 req-dd913bc9-1d2f-4374-8459-538def1467ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043557 Aug 18 11:15:01.824695 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 486/987] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:01.998785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:01.999419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:02.005802 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:02.006287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:02.006726 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:02.007415 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:02.007865 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:02.008287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:02.060617 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:02.061105 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:02.061561 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:02.062007 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lazy-loading 'fault' on Instance uuid 73be4b02-3890-46eb-a65c-d1fcdc999c97 {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:15:02.108063 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:02.115526 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-38c5ff91-804e-46cd-8ae7-908e95661603 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 200 len: 1309 microversion: 2.1 time: 0.120599 Aug 18 11:15:02.117078 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 502/988] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:01 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:15:03.137255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:03.137946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: 73be4b02-3890-46eb-a65c-d1fcdc999c97] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:03.144735 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:03.145214 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:03.145689 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:03.146354 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:03.146800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:03.147216 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:03.160560 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] HTTP exception thrown: Instance 73be4b02-3890-46eb-a65c-d1fcdc999c97 could not be found. Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Request method failure captured: Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 HTTP/1.1 Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_h8AIDcXq5YzU-nvLVWwzr9nS4ZFw0upW-K6eOvxPDwwPceII5hg_R1RQPorLPr0ITEqfzcDAFBAlbeUywhJhvZLjPtYjQgWOwO00_XtChABbfqp571y_jaezBhhem3QoVuf6ge9lR7yxZaWGfsE99LtuF6C_b5urZFZyfmW6iCIIWA Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: dcfe3f8963494889a66d9264dc7d50cc Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-VolumesSnapshotTestJSON-761770956 Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:15:03.162215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dcfe3f8963494889a66d9264dc7d50cc", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcfe3f8963494889a66d9264dc7d50cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcfe3f8963494889a66d9264dc7d50cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dcfe3f8963494889a66d9264dc7d50cc"}]}] Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-VolumesSnapshotTestJSON-761770956 Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: dcfe3f8963494889a66d9264dc7d50cc Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-761770956 Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-VolumesSnapshotTestJSON-761770956-project Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: a534cf41cb884baea52d1021d2789e8f Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-VolumesSnapshotTestJSON-761770956-project Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 73be4b02-3890-46eb-a65c-d1fcdc999c97 could not be found. Aug 18 11:15:03.163852 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '73be4b02-3890-46eb-a65c-d1fcdc999c97'} Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73be4b02-3890-46eb-a65c-d1fcdc999c97 could not be found. Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:15:03.164812 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73be4b02-3890-46eb-a65c-d1fcdc999c97 could not be found. Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73be4b02-3890-46eb-a65c-d1fcdc999c97 could not be found. Aug 18 11:15:03.166485 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:15:03.167950 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Returning 404 to user: Instance 73be4b02-3890-46eb-a65c-d1fcdc999c97 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:15:03.167950 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-39d19192-612c-475a-bf58-05686f49b3aa tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97" status: 404 len: 111 microversion: 2.1 time: 0.030546 Aug 18 11:15:03.167950 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 487/989] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:03 2022] GET /compute/v2.1/servers/73be4b02-3890-46eb-a65c-d1fcdc999c97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:15:10.969753 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-732316906", "imageRef": "f7d1cd7f-df33-47b1-8867-e6552bc3ca0e", "flavorRef": "452", "networks": [{"uuid": "a5b79be7-2ee5-40b2-a19e-7d09068762d4"}]}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:11.024842 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.network.neutron [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] validate_networks() for [('a5b79be7-2ee5-40b2-a19e-7d09068762d4', None, None, None, None, None)] {{(pid=120800) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:15:11.440350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Flavor limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:15:11.440765 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Image limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:15:11.441259 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Flavor pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:15:11.441726 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Image pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:15:11.442156 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:15:11.450733 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:11.451203 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:11.451657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:11.452333 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:11.452777 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:11.453190 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:11.470264 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Getting quotas for project dcfe3f8963494889a66d9264dc7d50cc. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:15:11.474341 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Getting quotas for user a534cf41cb884baea52d1021d2789e8f and project dcfe3f8963494889a66d9264dc7d50cc. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:15:11.485830 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Going to run 1 instances... {{(pid=120800) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:15:11.488061 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7d1cd7f-df33-47b1-8867-e6552bc3ca0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:15:11.536533 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-2a7b32ff-1e11-4911-aa0b-b08458dc222b tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571421 Aug 18 11:15:11.537294 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 503/990] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:15:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:15:11.548830 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-be375949-a977-4983-8676-7f142c819437 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:11.549585 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-be375949-a977-4983-8676-7f142c819437 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:11.608827 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-be375949-a977-4983-8676-7f142c819437 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:11.616844 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-be375949-a977-4983-8676-7f142c819437 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1218 microversion: 2.1 time: 0.072683 Aug 18 11:15:11.618158 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 488/991] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:11 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:15:12.638832 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-855af010-12ea-4c82-9be4-0c40edc8e52c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:12.639451 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-855af010-12ea-4c82-9be4-0c40edc8e52c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:12.646497 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-855af010-12ea-4c82-9be4-0c40edc8e52c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:12.646985 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-855af010-12ea-4c82-9be4-0c40edc8e52c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:12.647417 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-855af010-12ea-4c82-9be4-0c40edc8e52c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:12.648114 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-855af010-12ea-4c82-9be4-0c40edc8e52c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:12.648566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-855af010-12ea-4c82-9be4-0c40edc8e52c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:12.648990 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-855af010-12ea-4c82-9be4-0c40edc8e52c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:12.713566 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-855af010-12ea-4c82-9be4-0c40edc8e52c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:12.721916 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-855af010-12ea-4c82-9be4-0c40edc8e52c tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1276 microversion: 2.1 time: 0.087811 Aug 18 11:15:12.722391 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 504/992] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:12 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:13.745408 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-bffd64f7-79ec-4219-8ad6-3796b02ed3da tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:13.746053 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-bffd64f7-79ec-4219-8ad6-3796b02ed3da tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:13.749548 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:13.754928 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bffd64f7-79ec-4219-8ad6-3796b02ed3da tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:13.755410 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bffd64f7-79ec-4219-8ad6-3796b02ed3da tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:13.756029 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bffd64f7-79ec-4219-8ad6-3796b02ed3da tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:13.756990 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bffd64f7-79ec-4219-8ad6-3796b02ed3da tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:13.757426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bffd64f7-79ec-4219-8ad6-3796b02ed3da tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:13.757871 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-bffd64f7-79ec-4219-8ad6-3796b02ed3da tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:13.938708 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-eb4902b2-2630-455d-bb2d-4a8132d29556 req-ea4fa2fa-a01a-4851-836d-94be9eb83c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc53a423-9a11-478a-b29a-c23a0bc99fc3", "tag": "36ce935e-d22d-4a81-b37f-01e0dcfb2ba5"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:13.953235 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-eb4902b2-2630-455d-bb2d-4a8132d29556 req-ea4fa2fa-a01a-4851-836d-94be9eb83c2e service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:13.954554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-eb4902b2-2630-455d-bb2d-4a8132d29556 req-ea4fa2fa-a01a-4851-836d-94be9eb83c2e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:13.955158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-eb4902b2-2630-455d-bb2d-4a8132d29556 req-ea4fa2fa-a01a-4851-836d-94be9eb83c2e service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:13.969382 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-eb4902b2-2630-455d-bb2d-4a8132d29556 req-ea4fa2fa-a01a-4851-836d-94be9eb83c2e service nova] Creating event network-changed:36ce935e-d22d-4a81-b37f-01e0dcfb2ba5 for instance bc53a423-9a11-478a-b29a-c23a0bc99fc3 on hv-cinder-82660 Aug 18 11:15:13.974535 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-eb4902b2-2630-455d-bb2d-4a8132d29556 req-ea4fa2fa-a01a-4851-836d-94be9eb83c2e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040849 Aug 18 11:15:13.975133 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 505/993] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:15:14.031509 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-bffd64f7-79ec-4219-8ad6-3796b02ed3da tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:14.039543 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-bffd64f7-79ec-4219-8ad6-3796b02ed3da tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1318 microversion: 2.1 time: 0.297929 Aug 18 11:15:14.040106 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 489/994] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:13 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:15.061091 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-198bc993-f2b0-4f6c-bce0-a75b464eb4ff tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:15.061810 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-198bc993-f2b0-4f6c-bce0-a75b464eb4ff tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:15.068449 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-198bc993-f2b0-4f6c-bce0-a75b464eb4ff tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:15.068937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-198bc993-f2b0-4f6c-bce0-a75b464eb4ff tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:15.069375 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-198bc993-f2b0-4f6c-bce0-a75b464eb4ff tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:15.070107 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-198bc993-f2b0-4f6c-bce0-a75b464eb4ff tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:15.070563 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-198bc993-f2b0-4f6c-bce0-a75b464eb4ff tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:15.070983 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-198bc993-f2b0-4f6c-bce0-a75b464eb4ff tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:15.205089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-198bc993-f2b0-4f6c-bce0-a75b464eb4ff tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:15.211932 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-198bc993-f2b0-4f6c-bce0-a75b464eb4ff tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1318 microversion: 2.1 time: 0.155093 Aug 18 11:15:15.212501 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 506/995] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:15 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:16.235134 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4a8375d7-e014-49df-af89-f99ac4cee1b1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:16.235778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4a8375d7-e014-49df-af89-f99ac4cee1b1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:16.242259 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4a8375d7-e014-49df-af89-f99ac4cee1b1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:16.242743 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4a8375d7-e014-49df-af89-f99ac4cee1b1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:16.243183 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4a8375d7-e014-49df-af89-f99ac4cee1b1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:16.243883 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4a8375d7-e014-49df-af89-f99ac4cee1b1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:16.244337 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4a8375d7-e014-49df-af89-f99ac4cee1b1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:16.244764 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4a8375d7-e014-49df-af89-f99ac4cee1b1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:16.374688 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4a8375d7-e014-49df-af89-f99ac4cee1b1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:16.382357 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4a8375d7-e014-49df-af89-f99ac4cee1b1 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1318 microversion: 2.1 time: 0.152246 Aug 18 11:15:16.382913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 490/996] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:16 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:17.403297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e15b5725-83fe-4c28-8f34-d5414400f425 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:17.403936 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e15b5725-83fe-4c28-8f34-d5414400f425 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:17.409910 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e15b5725-83fe-4c28-8f34-d5414400f425 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:17.410402 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e15b5725-83fe-4c28-8f34-d5414400f425 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:17.410835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e15b5725-83fe-4c28-8f34-d5414400f425 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:17.411536 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e15b5725-83fe-4c28-8f34-d5414400f425 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:17.411990 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e15b5725-83fe-4c28-8f34-d5414400f425 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:17.412410 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e15b5725-83fe-4c28-8f34-d5414400f425 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:17.553032 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e15b5725-83fe-4c28-8f34-d5414400f425 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:17.561155 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e15b5725-83fe-4c28-8f34-d5414400f425 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1318 microversion: 2.1 time: 0.162268 Aug 18 11:15:17.561744 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 507/997] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:17 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:18.582597 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-24e2f8a2-1337-4eb8-ac5b-b7f68045fff5 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:18.583196 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-24e2f8a2-1337-4eb8-ac5b-b7f68045fff5 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:18.589238 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-24e2f8a2-1337-4eb8-ac5b-b7f68045fff5 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:18.589760 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-24e2f8a2-1337-4eb8-ac5b-b7f68045fff5 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:18.590204 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-24e2f8a2-1337-4eb8-ac5b-b7f68045fff5 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:18.590903 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-24e2f8a2-1337-4eb8-ac5b-b7f68045fff5 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:18.591906 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-24e2f8a2-1337-4eb8-ac5b-b7f68045fff5 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:18.592660 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-24e2f8a2-1337-4eb8-ac5b-b7f68045fff5 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:18.724884 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-24e2f8a2-1337-4eb8-ac5b-b7f68045fff5 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:18.732442 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-24e2f8a2-1337-4eb8-ac5b-b7f68045fff5 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1318 microversion: 2.1 time: 0.153902 Aug 18 11:15:18.733040 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 491/998] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:18 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:19.115202 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-c78e8cf8-221e-4658-8115-9e1b8db1e425 req-a53f07f9-f5ca-41e1-b89c-b31b9145eea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc53a423-9a11-478a-b29a-c23a0bc99fc3", "name": "network-vif-plugged", "status": "completed", "tag": "36ce935e-d22d-4a81-b37f-01e0dcfb2ba5"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:19.126655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-c78e8cf8-221e-4658-8115-9e1b8db1e425 req-a53f07f9-f5ca-41e1-b89c-b31b9145eea7 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:19.127141 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-c78e8cf8-221e-4658-8115-9e1b8db1e425 req-a53f07f9-f5ca-41e1-b89c-b31b9145eea7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:19.127573 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-c78e8cf8-221e-4658-8115-9e1b8db1e425 req-a53f07f9-f5ca-41e1-b89c-b31b9145eea7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:19.142266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-c78e8cf8-221e-4658-8115-9e1b8db1e425 req-a53f07f9-f5ca-41e1-b89c-b31b9145eea7 service nova] Creating event network-vif-plugged:36ce935e-d22d-4a81-b37f-01e0dcfb2ba5 for instance bc53a423-9a11-478a-b29a-c23a0bc99fc3 on hv-cinder-82660 Aug 18 11:15:19.147204 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-c78e8cf8-221e-4658-8115-9e1b8db1e425 req-a53f07f9-f5ca-41e1-b89c-b31b9145eea7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035681 Aug 18 11:15:19.147802 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 508/999] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:19.753699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-d1c6ab79-cf54-4ce3-909b-6750eadbfe84 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:19.754313 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-d1c6ab79-cf54-4ce3-909b-6750eadbfe84 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:19.760728 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1c6ab79-cf54-4ce3-909b-6750eadbfe84 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:19.761207 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1c6ab79-cf54-4ce3-909b-6750eadbfe84 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:19.761664 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1c6ab79-cf54-4ce3-909b-6750eadbfe84 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:19.762355 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1c6ab79-cf54-4ce3-909b-6750eadbfe84 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:19.762807 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1c6ab79-cf54-4ce3-909b-6750eadbfe84 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:19.763874 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-d1c6ab79-cf54-4ce3-909b-6750eadbfe84 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:19.896515 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-d1c6ab79-cf54-4ce3-909b-6750eadbfe84 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:19.906122 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-d1c6ab79-cf54-4ce3-909b-6750eadbfe84 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1318 microversion: 2.1 time: 0.156230 Aug 18 11:15:19.906700 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 492/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:19 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:20.928625 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b11dc68d-27da-4bc4-8e0a-7ce44e3782ae tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:20.929313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b11dc68d-27da-4bc4-8e0a-7ce44e3782ae tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:20.935977 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b11dc68d-27da-4bc4-8e0a-7ce44e3782ae tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:20.936554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b11dc68d-27da-4bc4-8e0a-7ce44e3782ae tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:20.937033 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b11dc68d-27da-4bc4-8e0a-7ce44e3782ae tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:20.937773 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b11dc68d-27da-4bc4-8e0a-7ce44e3782ae tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:20.938227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b11dc68d-27da-4bc4-8e0a-7ce44e3782ae tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:20.938645 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b11dc68d-27da-4bc4-8e0a-7ce44e3782ae tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:21.068567 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b11dc68d-27da-4bc4-8e0a-7ce44e3782ae tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:21.076593 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b11dc68d-27da-4bc4-8e0a-7ce44e3782ae tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1508 microversion: 2.1 time: 0.152103 Aug 18 11:15:21.077146 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 509/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:20 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:21.097334 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-8568c759-a5c0-44d9-81c9-143e41a49f5e tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dadec332-0aed-4206-a749-fdfc686f50c1", "device": "/dev/sdb"}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:21.100329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-8568c759-a5c0-44d9-81c9-143e41a49f5e tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:21.106856 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8568c759-a5c0-44d9-81c9-143e41a49f5e tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:21.107357 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8568c759-a5c0-44d9-81c9-143e41a49f5e tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:21.107866 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8568c759-a5c0-44d9-81c9-143e41a49f5e tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:21.108558 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8568c759-a5c0-44d9-81c9-143e41a49f5e tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:21.109014 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8568c759-a5c0-44d9-81c9-143e41a49f5e tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:21.109441 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-8568c759-a5c0-44d9-81c9-143e41a49f5e tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:21.352553 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-8568c759-a5c0-44d9-81c9-143e41a49f5e tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "POST /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258901 Aug 18 11:15:21.353203 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 493/1002] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Aug 18 11:15:21 2022] POST /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:15:32.206806 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:32.207813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=6 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:32.208353 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:32.208905 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:32.213559 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9ab64750-4797-425a-8eeb-3176c28921d1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:32.214120 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9ab64750-4797-425a-8eeb-3176c28921d1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:32.225774 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ab64750-4797-425a-8eeb-3176c28921d1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:32.226279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ab64750-4797-425a-8eeb-3176c28921d1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:32.226729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ab64750-4797-425a-8eeb-3176c28921d1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:32.227470 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ab64750-4797-425a-8eeb-3176c28921d1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:32.227932 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ab64750-4797-425a-8eeb-3176c28921d1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:32.228364 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ab64750-4797-425a-8eeb-3176c28921d1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:32.255050 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9ab64750-4797-425a-8eeb-3176c28921d1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Going to try to terminate instance {{(pid=120800) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:15:32.331974 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9ab64750-4797-425a-8eeb-3176c28921d1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 204 len: 0 microversion: 2.1 time: 0.125924 Aug 18 11:15:32.332666 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 510/1003] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:15:32 2022] DELETE /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:15:32.339393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:32.340462 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=22 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:32.341810 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:32.346606 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-7f3208d1-0bf1-4e2d-abb0-3d849cee5812 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:32.347259 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-7f3208d1-0bf1-4e2d-abb0-3d849cee5812 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:32.355491 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f3208d1-0bf1-4e2d-abb0-3d849cee5812 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:32.356002 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f3208d1-0bf1-4e2d-abb0-3d849cee5812 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:32.356499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f3208d1-0bf1-4e2d-abb0-3d849cee5812 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:32.357546 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f3208d1-0bf1-4e2d-abb0-3d849cee5812 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:32.358009 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f3208d1-0bf1-4e2d-abb0-3d849cee5812 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:32.358441 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-7f3208d1-0bf1-4e2d-abb0-3d849cee5812 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:32.504366 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-7f3208d1-0bf1-4e2d-abb0-3d849cee5812 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:32.511873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-7f3208d1-0bf1-4e2d-abb0-3d849cee5812 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1575 microversion: 2.1 time: 0.174561 Aug 18 11:15:32.512431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 494/1004] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:32 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:33.534069 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6522d75e-0f21-472e-b47c-204e2a0bfdd0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:33.534767 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6522d75e-0f21-472e-b47c-204e2a0bfdd0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:33.541115 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6522d75e-0f21-472e-b47c-204e2a0bfdd0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:33.541599 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6522d75e-0f21-472e-b47c-204e2a0bfdd0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:33.542037 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6522d75e-0f21-472e-b47c-204e2a0bfdd0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:33.542725 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6522d75e-0f21-472e-b47c-204e2a0bfdd0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:33.543180 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6522d75e-0f21-472e-b47c-204e2a0bfdd0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:33.543602 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6522d75e-0f21-472e-b47c-204e2a0bfdd0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:33.683708 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6522d75e-0f21-472e-b47c-204e2a0bfdd0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:33.691625 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6522d75e-0f21-472e-b47c-204e2a0bfdd0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1575 microversion: 2.1 time: 0.161785 Aug 18 11:15:33.692189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 511/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:33 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:34.713638 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-cd701515-b452-40b7-8409-1c895a3f8c34 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:34.714244 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-cd701515-b452-40b7-8409-1c895a3f8c34 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:34.720845 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cd701515-b452-40b7-8409-1c895a3f8c34 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:34.721320 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cd701515-b452-40b7-8409-1c895a3f8c34 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:34.721778 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cd701515-b452-40b7-8409-1c895a3f8c34 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:34.722471 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cd701515-b452-40b7-8409-1c895a3f8c34 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:34.722916 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cd701515-b452-40b7-8409-1c895a3f8c34 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:34.723331 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cd701515-b452-40b7-8409-1c895a3f8c34 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:34.858868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-cd701515-b452-40b7-8409-1c895a3f8c34 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:34.866532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-cd701515-b452-40b7-8409-1c895a3f8c34 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1575 microversion: 2.1 time: 0.156835 Aug 18 11:15:34.867097 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 495/1006] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:34 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:35.889507 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-952ef857-a234-458e-ad87-28fb383696c1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:35.890278 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-952ef857-a234-458e-ad87-28fb383696c1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:35.896917 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-952ef857-a234-458e-ad87-28fb383696c1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:35.897419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-952ef857-a234-458e-ad87-28fb383696c1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:35.897901 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-952ef857-a234-458e-ad87-28fb383696c1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:35.898619 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-952ef857-a234-458e-ad87-28fb383696c1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:35.899079 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-952ef857-a234-458e-ad87-28fb383696c1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:35.899507 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-952ef857-a234-458e-ad87-28fb383696c1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:36.034455 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-952ef857-a234-458e-ad87-28fb383696c1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:36.042686 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-952ef857-a234-458e-ad87-28fb383696c1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1575 microversion: 2.1 time: 0.157763 Aug 18 11:15:36.043400 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 512/1007] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:35 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:36.704130 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-3a6ed159-1f27-4df7-8b17-e45ec1a6fe4e req-c1618f1c-c874-4450-a369-6cad53478729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb72685-d575-48ff-b600-bd170ababcc6", "name": "network-vif-deleted", "tag": "5da87f89-c818-40e2-8e37-bd667f9561bf"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:36.724393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-3a6ed159-1f27-4df7-8b17-e45ec1a6fe4e req-c1618f1c-c874-4450-a369-6cad53478729 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:36.725471 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-3a6ed159-1f27-4df7-8b17-e45ec1a6fe4e req-c1618f1c-c874-4450-a369-6cad53478729 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:36.726393 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-3a6ed159-1f27-4df7-8b17-e45ec1a6fe4e req-c1618f1c-c874-4450-a369-6cad53478729 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:36.744413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-3a6ed159-1f27-4df7-8b17-e45ec1a6fe4e req-c1618f1c-c874-4450-a369-6cad53478729 service nova] Creating event network-vif-deleted:5da87f89-c818-40e2-8e37-bd667f9561bf for instance 2cb72685-d575-48ff-b600-bd170ababcc6 on hv-cinder-82660 Aug 18 11:15:36.751015 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-3a6ed159-1f27-4df7-8b17-e45ec1a6fe4e req-c1618f1c-c874-4450-a369-6cad53478729 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052603 Aug 18 11:15:36.751920 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 496/1008] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:15:37.066889 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:37.068144 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:37.074694 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:37.075361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:37.075866 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:37.076891 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:37.077354 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:37.077818 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:37.116864 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:37.117163 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:37.117637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:37.118089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.objects.instance [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lazy-loading 'fault' on Instance uuid 2cb72685-d575-48ff-b600-bd170ababcc6 {{(pid=120800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:15:37.159168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:37.167143 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-5471ecd8-9ea5-4690-9be2-cdd393f4e6f5 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 200 len: 1230 microversion: 2.1 time: 0.105526 Aug 18 11:15:37.169089 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 513/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:37 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:37.644143 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-cf6d762f-5993-477f-bcfc-36be78668f93 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:37.644725 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-cf6d762f-5993-477f-bcfc-36be78668f93 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:37.651742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cf6d762f-5993-477f-bcfc-36be78668f93 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:37.652261 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cf6d762f-5993-477f-bcfc-36be78668f93 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:37.652697 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cf6d762f-5993-477f-bcfc-36be78668f93 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:37.654483 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cf6d762f-5993-477f-bcfc-36be78668f93 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:37.654945 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cf6d762f-5993-477f-bcfc-36be78668f93 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:37.655598 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cf6d762f-5993-477f-bcfc-36be78668f93 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:37.741788 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-cf6d762f-5993-477f-bcfc-36be78668f93 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lazy-loading 'services' on Instance uuid bc53a423-9a11-478a-b29a-c23a0bc99fc3 {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:15:37.814345 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-cf6d762f-5993-477f-bcfc-36be78668f93 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3/os-volume_attachments/dadec332-0aed-4206-a749-fdfc686f50c1" status: 202 len: 0 microversion: 2.1 time: 0.174347 Aug 18 11:15:37.814935 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 497/1010] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Aug 18 11:15:37 2022] DELETE /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3/os-volume_attachments/dadec332-0aed-4206-a749-fdfc686f50c1 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:15:38.190415 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:38.191012 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:38.197637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:38.198122 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:38.198555 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:38.199244 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:38.199740 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:38.200734 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:38.217265 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] HTTP exception thrown: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Request method failure captured: Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 HTTP/1.1 Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_h6wNzQLKfmw3iV8DW5NnS5yuE_2x3hmGFu29cGoQHy-UcjwRzbd2mtWd4FzfE4bTcfWRtQFhtgckmOuS41WRmEIemN3_-5eOY4cB457Je91YB5HZ3Wnhb-UmqEeCvSRNwt0zi7OIRMWzT98Rzebimh-_UacsMhqqegOctlo3ASgD1E Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 4cd8f29717d84b5ebfa176b0040f5778 Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-TestVolumeBootPattern-822241465 Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:15:38.219070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4cd8f29717d84b5ebfa176b0040f5778", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4cd8f29717d84b5ebfa176b0040f5778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4cd8f29717d84b5ebfa176b0040f5778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4cd8f29717d84b5ebfa176b0040f5778"}]}] Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-TestVolumeBootPattern-822241465 Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 4cd8f29717d84b5ebfa176b0040f5778 Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-TestVolumeBootPattern-822241465 Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-TestVolumeBootPattern-822241465-project Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: d4e3a8a1512c47a19cd3c23f171e24c6 Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-TestVolumeBootPattern-822241465-project Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:15:38.220780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '2cb72685-d575-48ff-b600-bd170ababcc6'} Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:15:38.221876 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:15:38.223465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:15:38.224909 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Returning 404 to user: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:15:38.224909 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9658343f-5524-4d60-aa28-272dd0989b32 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 404 len: 111 microversion: 2.1 time: 0.033974 Aug 18 11:15:38.224909 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 514/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:38 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:15:38.322388 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1982042649", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1576310350", "security_groups": [{"name": "tempest-secgroup-smoke-30560218"}], "block_device_mapping_v2": [{"uuid": "61b7256c-4a75-4bd4-966f-e7753d2b7d13", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b05b383-4bc5-4d6f-8868-dc946d4228f7"}]}} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:38.443876 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.network.neutron [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] validate_networks() for [('2b05b383-4bc5-4d6f-8868-dc946d4228f7', None, None, None, None, None)] {{(pid=120801) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:15:38.836834 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Flavor limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:15:38.837405 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Image limits 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:15:38.837742 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Flavor pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:15:38.838153 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Image pref 0:0:0 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:15:38.838582 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.virt.hardware [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:15:38.848140 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:38.848615 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:38.849044 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:38.849788 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:38.850236 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:38.850656 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:38.867921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Getting quotas for project 4cd8f29717d84b5ebfa176b0040f5778. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:15:38.871822 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.quota [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Getting quotas for user d4e3a8a1512c47a19cd3c23f171e24c6 and project 4cd8f29717d84b5ebfa176b0040f5778. Resources: {'cores', 'ram', 'instances'} {{(pid=120801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:15:38.936667 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Going to run 1 instances... {{(pid=120801) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:15:38.939011 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61b7256c-4a75-4bd4-966f-e7753d2b7d13',volume_size=None,volume_type=None)] {{(pid=120801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:15:38.939825 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-de5f3b80-fc53-4a86-8971-3e39b0ab78cf tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:38.940328 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-de5f3b80-fc53-4a86-8971-3e39b0ab78cf tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:38.951968 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de5f3b80-fc53-4a86-8971-3e39b0ab78cf tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:38.952614 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de5f3b80-fc53-4a86-8971-3e39b0ab78cf tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:38.953168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de5f3b80-fc53-4a86-8971-3e39b0ab78cf tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:38.954335 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de5f3b80-fc53-4a86-8971-3e39b0ab78cf tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:38.955094 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de5f3b80-fc53-4a86-8971-3e39b0ab78cf tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:38.955620 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de5f3b80-fc53-4a86-8971-3e39b0ab78cf tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:38.990572 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-de5f3b80-fc53-4a86-8971-3e39b0ab78cf tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Going to try to terminate instance {{(pid=120800) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:15:39.084874 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-de5f3b80-fc53-4a86-8971-3e39b0ab78cf tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 204 len: 0 microversion: 2.1 time: 0.148323 Aug 18 11:15:39.086227 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 515/1012] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:15:38 2022] DELETE /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:15:39.095659 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-9cf46a2f-fdbc-4add-8e4b-8203ae2a433b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.777407 Aug 18 11:15:39.096413 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 498/1013] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:15:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:15:39.108376 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-8fee9b84-6306-444e-9778-ac0fffd50021 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:39.109378 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-8fee9b84-6306-444e-9778-ac0fffd50021 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:39.109885 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1dc7dacd-9b77-41db-bdf5-cbce3a1ad2d0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:39.110864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-1dc7dacd-9b77-41db-bdf5-cbce3a1ad2d0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:39.116537 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8fee9b84-6306-444e-9778-ac0fffd50021 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:39.117214 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8fee9b84-6306-444e-9778-ac0fffd50021 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:39.117935 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8fee9b84-6306-444e-9778-ac0fffd50021 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:39.118442 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8fee9b84-6306-444e-9778-ac0fffd50021 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:39.119226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8fee9b84-6306-444e-9778-ac0fffd50021 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:39.119331 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-8fee9b84-6306-444e-9778-ac0fffd50021 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:39.179419 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-1dc7dacd-9b77-41db-bdf5-cbce3a1ad2d0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:39.187522 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1dc7dacd-9b77-41db-bdf5-cbce3a1ad2d0 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1095 microversion: 2.1 time: 0.083567 Aug 18 11:15:39.188097 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 499/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:39 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:15:39.279604 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-8fee9b84-6306-444e-9778-ac0fffd50021 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:39.288917 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-8fee9b84-6306-444e-9778-ac0fffd50021 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1514 microversion: 2.1 time: 0.196977 Aug 18 11:15:39.289466 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 516/1015] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:39 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:40.208534 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a4e61bcd-0652-4612-85a2-6dd60e72170e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:40.209150 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a4e61bcd-0652-4612-85a2-6dd60e72170e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:40.216800 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4e61bcd-0652-4612-85a2-6dd60e72170e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:40.217295 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4e61bcd-0652-4612-85a2-6dd60e72170e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:40.217770 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4e61bcd-0652-4612-85a2-6dd60e72170e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:40.218553 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4e61bcd-0652-4612-85a2-6dd60e72170e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:40.218935 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4e61bcd-0652-4612-85a2-6dd60e72170e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:40.219370 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a4e61bcd-0652-4612-85a2-6dd60e72170e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:40.281655 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a4e61bcd-0652-4612-85a2-6dd60e72170e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:40.289423 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a4e61bcd-0652-4612-85a2-6dd60e72170e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1145 microversion: 2.1 time: 0.085027 Aug 18 11:15:40.290016 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 500/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:40 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:40.312494 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-41da434d-4619-467d-bf43-3219cc085153 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:40.313143 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-41da434d-4619-467d-bf43-3219cc085153 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:40.319660 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41da434d-4619-467d-bf43-3219cc085153 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:40.320147 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41da434d-4619-467d-bf43-3219cc085153 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:40.320584 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41da434d-4619-467d-bf43-3219cc085153 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:40.321279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41da434d-4619-467d-bf43-3219cc085153 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:40.321768 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41da434d-4619-467d-bf43-3219cc085153 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:40.322239 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-41da434d-4619-467d-bf43-3219cc085153 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:40.454622 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-41da434d-4619-467d-bf43-3219cc085153 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:40.462159 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-41da434d-4619-467d-bf43-3219cc085153 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1514 microversion: 2.1 time: 0.154166 Aug 18 11:15:40.462846 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 517/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:40 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:41.310240 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a5d15699-e6d2-407d-a152-d6673565055d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:41.310859 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a5d15699-e6d2-407d-a152-d6673565055d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:41.317697 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5d15699-e6d2-407d-a152-d6673565055d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:41.318285 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5d15699-e6d2-407d-a152-d6673565055d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:41.318796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5d15699-e6d2-407d-a152-d6673565055d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:41.319906 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5d15699-e6d2-407d-a152-d6673565055d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:41.320437 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5d15699-e6d2-407d-a152-d6673565055d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:41.320941 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a5d15699-e6d2-407d-a152-d6673565055d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:41.414614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a5d15699-e6d2-407d-a152-d6673565055d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:41.423933 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a5d15699-e6d2-407d-a152-d6673565055d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1211 microversion: 2.1 time: 0.117672 Aug 18 11:15:41.424757 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 501/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:41 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1211 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:15:41.485372 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1e7d4052-2392-461f-9aa0-087461f20295 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:41.486202 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1e7d4052-2392-461f-9aa0-087461f20295 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:41.494982 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e7d4052-2392-461f-9aa0-087461f20295 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:41.495590 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e7d4052-2392-461f-9aa0-087461f20295 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:41.496254 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e7d4052-2392-461f-9aa0-087461f20295 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:41.497896 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e7d4052-2392-461f-9aa0-087461f20295 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:41.498377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e7d4052-2392-461f-9aa0-087461f20295 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:41.498809 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1e7d4052-2392-461f-9aa0-087461f20295 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:41.660681 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1e7d4052-2392-461f-9aa0-087461f20295 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a534cf41cb884baea52d1021d2789e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfe3f8963494889a66d9264dc7d50cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:41.670220 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1e7d4052-2392-461f-9aa0-087461f20295 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 200 len: 1514 microversion: 2.1 time: 0.190397 Aug 18 11:15:41.671398 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 518/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:41 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:41.829274 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-46e4c9c7-6ec0-4048-bc19-123118b5a115 req-904bcd38-7fe7-4e52-a161-853aceca19b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc53a423-9a11-478a-b29a-c23a0bc99fc3", "name": "network-vif-deleted", "tag": "36ce935e-d22d-4a81-b37f-01e0dcfb2ba5"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:41.839567 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-46e4c9c7-6ec0-4048-bc19-123118b5a115 req-904bcd38-7fe7-4e52-a161-853aceca19b5 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:41.840692 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-46e4c9c7-6ec0-4048-bc19-123118b5a115 req-904bcd38-7fe7-4e52-a161-853aceca19b5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:41.841155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-46e4c9c7-6ec0-4048-bc19-123118b5a115 req-904bcd38-7fe7-4e52-a161-853aceca19b5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:41.853422 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-46e4c9c7-6ec0-4048-bc19-123118b5a115 req-904bcd38-7fe7-4e52-a161-853aceca19b5 service nova] Creating event network-vif-deleted:36ce935e-d22d-4a81-b37f-01e0dcfb2ba5 for instance bc53a423-9a11-478a-b29a-c23a0bc99fc3 on hv-cinder-82660 Aug 18 11:15:41.859780 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-46e4c9c7-6ec0-4048-bc19-123118b5a115 req-904bcd38-7fe7-4e52-a161-853aceca19b5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034410 Aug 18 11:15:41.860900 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 502/1020] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:42.445534 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-60407359-616e-4daf-9025-7a4fa25d2229 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:42.446350 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-60407359-616e-4daf-9025-7a4fa25d2229 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:42.452384 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60407359-616e-4daf-9025-7a4fa25d2229 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:42.452944 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60407359-616e-4daf-9025-7a4fa25d2229 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:42.453465 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60407359-616e-4daf-9025-7a4fa25d2229 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:42.454257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60407359-616e-4daf-9025-7a4fa25d2229 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:42.454772 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60407359-616e-4daf-9025-7a4fa25d2229 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:42.455197 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-60407359-616e-4daf-9025-7a4fa25d2229 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:42.592788 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-60407359-616e-4daf-9025-7a4fa25d2229 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:42.600697 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-60407359-616e-4daf-9025-7a4fa25d2229 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.158994 Aug 18 11:15:42.601943 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 519/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:42 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:42.693281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:42.694022 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] [instance: bc53a423-9a11-478a-b29a-c23a0bc99fc3] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:42.700680 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:42.701365 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:42.701833 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:42.702526 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:42.702973 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:42.703445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:42.716840 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] HTTP exception thrown: Instance bc53a423-9a11-478a-b29a-c23a0bc99fc3 could not be found. Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Request method failure captured: Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 HTTP/1.1 Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_h8AIDcXq5YzU-nvLVWwzr9nS4ZFw0upW-K6eOvxPDwwPceII5hg_R1RQPorLPr0ITEqfzcDAFBAlbeUywhJhvZLjPtYjQgWOwO00_XtChABbfqp571y_jaezBhhem3QoVuf6ge9lR7yxZaWGfsE99LtuF6C_b5urZFZyfmW6iCIIWA Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: dcfe3f8963494889a66d9264dc7d50cc Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-VolumesSnapshotTestJSON-761770956 Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:15:42.718496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dcfe3f8963494889a66d9264dc7d50cc", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcfe3f8963494889a66d9264dc7d50cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dcfe3f8963494889a66d9264dc7d50cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dcfe3f8963494889a66d9264dc7d50cc"}]}] Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-VolumesSnapshotTestJSON-761770956 Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: dcfe3f8963494889a66d9264dc7d50cc Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-761770956 Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-VolumesSnapshotTestJSON-761770956-project Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: a534cf41cb884baea52d1021d2789e8f Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-VolumesSnapshotTestJSON-761770956-project Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance bc53a423-9a11-478a-b29a-c23a0bc99fc3 could not be found. Aug 18 11:15:42.720148 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': 'bc53a423-9a11-478a-b29a-c23a0bc99fc3'} Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc53a423-9a11-478a-b29a-c23a0bc99fc3 could not be found. Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:15:42.724690 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc53a423-9a11-478a-b29a-c23a0bc99fc3 could not be found. Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc53a423-9a11-478a-b29a-c23a0bc99fc3 could not be found. Aug 18 11:15:42.726843 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:15:42.728218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] Returning 404 to user: Instance bc53a423-9a11-478a-b29a-c23a0bc99fc3 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:15:42.728218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4c21a4fd-1547-4039-aab7-e1d614a91277 tempest-VolumesSnapshotTestJSON-761770956 tempest-VolumesSnapshotTestJSON-761770956-project] 10.222.0.15 "GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3" status: 404 len: 111 microversion: 2.1 time: 0.031358 Aug 18 11:15:42.728218 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 503/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:42 2022] GET /compute/v2.1/servers/bc53a423-9a11-478a-b29a-c23a0bc99fc3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:15:43.623142 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-20b82ecc-206a-43f0-8e39-117073ae3be6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:43.623745 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-20b82ecc-206a-43f0-8e39-117073ae3be6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:43.630337 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-20b82ecc-206a-43f0-8e39-117073ae3be6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:43.630817 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-20b82ecc-206a-43f0-8e39-117073ae3be6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:43.631248 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-20b82ecc-206a-43f0-8e39-117073ae3be6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:43.631935 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-20b82ecc-206a-43f0-8e39-117073ae3be6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:43.632384 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-20b82ecc-206a-43f0-8e39-117073ae3be6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:43.632805 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-20b82ecc-206a-43f0-8e39-117073ae3be6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:43.768611 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-20b82ecc-206a-43f0-8e39-117073ae3be6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:43.776041 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-20b82ecc-206a-43f0-8e39-117073ae3be6 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.156800 Aug 18 11:15:43.776596 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 520/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:43 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:43.875211 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-053f929e-2c45-4d1d-8ea1-bcd9716071ae req-64cb9cd4-b961-4c6b-85a1-d9821746d395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e8224ec-e7e9-4e6b-b9d9-461d4b93f819", "tag": "04ed41d0-a64f-4f15-945c-b30d46f02565"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:43.884856 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-053f929e-2c45-4d1d-8ea1-bcd9716071ae req-64cb9cd4-b961-4c6b-85a1-d9821746d395 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:43.885338 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-053f929e-2c45-4d1d-8ea1-bcd9716071ae req-64cb9cd4-b961-4c6b-85a1-d9821746d395 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:43.885817 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-053f929e-2c45-4d1d-8ea1-bcd9716071ae req-64cb9cd4-b961-4c6b-85a1-d9821746d395 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:43.898902 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-053f929e-2c45-4d1d-8ea1-bcd9716071ae req-64cb9cd4-b961-4c6b-85a1-d9821746d395 service nova] Creating event network-changed:04ed41d0-a64f-4f15-945c-b30d46f02565 for instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 on hv-cinder-82660 Aug 18 11:15:43.905101 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-053f929e-2c45-4d1d-8ea1-bcd9716071ae req-64cb9cd4-b961-4c6b-85a1-d9821746d395 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033304 Aug 18 11:15:43.905741 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 504/1024] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:44.798941 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-62d6db66-b7d4-49d1-be2d-e45cb656bd09 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:44.799554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-62d6db66-b7d4-49d1-be2d-e45cb656bd09 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:44.806213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-62d6db66-b7d4-49d1-be2d-e45cb656bd09 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:44.806703 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-62d6db66-b7d4-49d1-be2d-e45cb656bd09 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:44.807137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-62d6db66-b7d4-49d1-be2d-e45cb656bd09 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:44.807832 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-62d6db66-b7d4-49d1-be2d-e45cb656bd09 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:44.808286 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-62d6db66-b7d4-49d1-be2d-e45cb656bd09 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:44.808710 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-62d6db66-b7d4-49d1-be2d-e45cb656bd09 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:44.948681 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-62d6db66-b7d4-49d1-be2d-e45cb656bd09 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:44.957463 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-62d6db66-b7d4-49d1-be2d-e45cb656bd09 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.162658 Aug 18 11:15:44.958063 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 521/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:44 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:45.979594 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-26442424-f5a0-418d-bc57-e8c268d5bd7d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:45.980216 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-26442424-f5a0-418d-bc57-e8c268d5bd7d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:45.990315 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-26442424-f5a0-418d-bc57-e8c268d5bd7d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:45.990825 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-26442424-f5a0-418d-bc57-e8c268d5bd7d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:45.991657 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-26442424-f5a0-418d-bc57-e8c268d5bd7d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:45.992367 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-26442424-f5a0-418d-bc57-e8c268d5bd7d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:45.992832 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-26442424-f5a0-418d-bc57-e8c268d5bd7d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:45.993266 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-26442424-f5a0-418d-bc57-e8c268d5bd7d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:46.127606 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-26442424-f5a0-418d-bc57-e8c268d5bd7d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:46.136516 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-26442424-f5a0-418d-bc57-e8c268d5bd7d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.161463 Aug 18 11:15:46.138164 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 505/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:45 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:47.159203 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-24078ea9-f6cb-489f-9fad-b44663f3bc30 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:47.159796 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-24078ea9-f6cb-489f-9fad-b44663f3bc30 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:47.166381 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-24078ea9-f6cb-489f-9fad-b44663f3bc30 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:47.166889 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-24078ea9-f6cb-489f-9fad-b44663f3bc30 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:47.167306 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-24078ea9-f6cb-489f-9fad-b44663f3bc30 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:47.168702 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-24078ea9-f6cb-489f-9fad-b44663f3bc30 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:47.169161 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-24078ea9-f6cb-489f-9fad-b44663f3bc30 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:47.169622 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-24078ea9-f6cb-489f-9fad-b44663f3bc30 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:47.300657 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-24078ea9-f6cb-489f-9fad-b44663f3bc30 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:47.308179 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-24078ea9-f6cb-489f-9fad-b44663f3bc30 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.153006 Aug 18 11:15:47.308771 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 522/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:47 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:48.328977 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-6a19b7a2-6d2d-46e7-92b6-44749c3f5fa4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:48.329605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-6a19b7a2-6d2d-46e7-92b6-44749c3f5fa4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:48.335720 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a19b7a2-6d2d-46e7-92b6-44749c3f5fa4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:48.336210 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a19b7a2-6d2d-46e7-92b6-44749c3f5fa4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:48.336648 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a19b7a2-6d2d-46e7-92b6-44749c3f5fa4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:48.337343 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a19b7a2-6d2d-46e7-92b6-44749c3f5fa4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:48.337835 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a19b7a2-6d2d-46e7-92b6-44749c3f5fa4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:48.338264 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-6a19b7a2-6d2d-46e7-92b6-44749c3f5fa4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:48.482090 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-6a19b7a2-6d2d-46e7-92b6-44749c3f5fa4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:48.489758 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-6a19b7a2-6d2d-46e7-92b6-44749c3f5fa4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.165283 Aug 18 11:15:48.490333 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 506/1028] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:48 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:49.512992 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-b6b4f4b0-1a78-435b-9ba0-642f888578eb tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:49.513644 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-b6b4f4b0-1a78-435b-9ba0-642f888578eb tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:49.520431 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6b4f4b0-1a78-435b-9ba0-642f888578eb tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:49.520911 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6b4f4b0-1a78-435b-9ba0-642f888578eb tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:49.521339 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6b4f4b0-1a78-435b-9ba0-642f888578eb tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:49.522075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6b4f4b0-1a78-435b-9ba0-642f888578eb tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:49.522524 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6b4f4b0-1a78-435b-9ba0-642f888578eb tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:49.522940 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-b6b4f4b0-1a78-435b-9ba0-642f888578eb tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:49.540923 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:49.668511 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-b6b4f4b0-1a78-435b-9ba0-642f888578eb tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:49.676338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-b6b4f4b0-1a78-435b-9ba0-642f888578eb tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.168138 Aug 18 11:15:49.676889 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 523/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:49 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:50.696262 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ed494f59-c6b4-4438-8a15-abcd777105cf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:50.696873 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ed494f59-c6b4-4438-8a15-abcd777105cf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:50.698886 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:50.700614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=8 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:50.707044 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed494f59-c6b4-4438-8a15-abcd777105cf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:50.707534 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed494f59-c6b4-4438-8a15-abcd777105cf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:50.707974 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed494f59-c6b4-4438-8a15-abcd777105cf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:50.708686 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed494f59-c6b4-4438-8a15-abcd777105cf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:50.709129 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed494f59-c6b4-4438-8a15-abcd777105cf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:50.709586 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ed494f59-c6b4-4438-8a15-abcd777105cf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:50.842746 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-ed494f59-c6b4-4438-8a15-abcd777105cf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:50.850630 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ed494f59-c6b4-4438-8a15-abcd777105cf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.158158 Aug 18 11:15:50.851215 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 507/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:50 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:15:51.873034 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-7c51cc3b-55af-49e9-a70b-36ae2c77c65e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:51.873671 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-7c51cc3b-55af-49e9-a70b-36ae2c77c65e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:51.880158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c51cc3b-55af-49e9-a70b-36ae2c77c65e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:51.880650 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c51cc3b-55af-49e9-a70b-36ae2c77c65e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:51.881087 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c51cc3b-55af-49e9-a70b-36ae2c77c65e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:51.881811 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c51cc3b-55af-49e9-a70b-36ae2c77c65e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:51.882268 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c51cc3b-55af-49e9-a70b-36ae2c77c65e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:51.882695 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-7c51cc3b-55af-49e9-a70b-36ae2c77c65e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:52.028121 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-7c51cc3b-55af-49e9-a70b-36ae2c77c65e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:52.035633 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-7c51cc3b-55af-49e9-a70b-36ae2c77c65e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.166932 Aug 18 11:15:52.036189 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 524/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:51 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:53.056101 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-62fdfc13-1c93-4425-a05e-2d3a18d12c7a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:53.056737 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-62fdfc13-1c93-4425-a05e-2d3a18d12c7a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:53.063430 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62fdfc13-1c93-4425-a05e-2d3a18d12c7a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:53.063913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62fdfc13-1c93-4425-a05e-2d3a18d12c7a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:53.064348 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62fdfc13-1c93-4425-a05e-2d3a18d12c7a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:53.065055 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62fdfc13-1c93-4425-a05e-2d3a18d12c7a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:53.065488 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62fdfc13-1c93-4425-a05e-2d3a18d12c7a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:53.065941 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-62fdfc13-1c93-4425-a05e-2d3a18d12c7a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:53.202855 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-62fdfc13-1c93-4425-a05e-2d3a18d12c7a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:53.210544 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-62fdfc13-1c93-4425-a05e-2d3a18d12c7a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.158282 Aug 18 11:15:53.211118 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 508/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:53 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:54.233026 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a48e394c-6c3a-4f05-a75e-5941c886293c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:54.233673 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a48e394c-6c3a-4f05-a75e-5941c886293c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:54.240672 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a48e394c-6c3a-4f05-a75e-5941c886293c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:54.241164 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a48e394c-6c3a-4f05-a75e-5941c886293c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:54.241664 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a48e394c-6c3a-4f05-a75e-5941c886293c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:54.242360 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a48e394c-6c3a-4f05-a75e-5941c886293c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:54.242813 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a48e394c-6c3a-4f05-a75e-5941c886293c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:54.243240 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a48e394c-6c3a-4f05-a75e-5941c886293c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:54.379614 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a48e394c-6c3a-4f05-a75e-5941c886293c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:54.387175 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a48e394c-6c3a-4f05-a75e-5941c886293c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.158635 Aug 18 11:15:54.388273 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 525/1033] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:54 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:54.687498 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-a255133c-03a2-486b-a5fb-1bbb56b87b23 req-409796e5-ce79-4fa5-9d25-4f262950f7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8224ec-e7e9-4e6b-b9d9-461d4b93f819", "name": "network-vif-plugged", "status": "completed", "tag": "04ed41d0-a64f-4f15-945c-b30d46f02565"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:54.697870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-a255133c-03a2-486b-a5fb-1bbb56b87b23 req-409796e5-ce79-4fa5-9d25-4f262950f7e4 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:54.698349 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-a255133c-03a2-486b-a5fb-1bbb56b87b23 req-409796e5-ce79-4fa5-9d25-4f262950f7e4 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:54.698776 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-a255133c-03a2-486b-a5fb-1bbb56b87b23 req-409796e5-ce79-4fa5-9d25-4f262950f7e4 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:54.710941 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-a255133c-03a2-486b-a5fb-1bbb56b87b23 req-409796e5-ce79-4fa5-9d25-4f262950f7e4 service nova] Creating event network-vif-plugged:04ed41d0-a64f-4f15-945c-b30d46f02565 for instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 on hv-cinder-82660 Aug 18 11:15:54.716917 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-a255133c-03a2-486b-a5fb-1bbb56b87b23 req-409796e5-ce79-4fa5-9d25-4f262950f7e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035490 Aug 18 11:15:54.717774 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 509/1034] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:55.408830 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-1507e7a0-2837-42c5-9dd9-1f68cae9246b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:55.409495 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-1507e7a0-2837-42c5-9dd9-1f68cae9246b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:55.416031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1507e7a0-2837-42c5-9dd9-1f68cae9246b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:55.416520 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1507e7a0-2837-42c5-9dd9-1f68cae9246b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:55.416960 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1507e7a0-2837-42c5-9dd9-1f68cae9246b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:55.417729 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1507e7a0-2837-42c5-9dd9-1f68cae9246b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:55.418855 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1507e7a0-2837-42c5-9dd9-1f68cae9246b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:55.419286 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-1507e7a0-2837-42c5-9dd9-1f68cae9246b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:55.559471 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-1507e7a0-2837-42c5-9dd9-1f68cae9246b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:55.566971 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-1507e7a0-2837-42c5-9dd9-1f68cae9246b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1265 microversion: 2.1 time: 0.162064 Aug 18 11:15:55.567535 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 526/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:55 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:56.588323 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b0064e4d-123b-4327-ac35-dd419748e0c4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:56.589014 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b0064e4d-123b-4327-ac35-dd419748e0c4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:56.595303 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0064e4d-123b-4327-ac35-dd419748e0c4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:56.595791 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0064e4d-123b-4327-ac35-dd419748e0c4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:56.596227 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0064e4d-123b-4327-ac35-dd419748e0c4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:56.596930 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0064e4d-123b-4327-ac35-dd419748e0c4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:56.597414 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0064e4d-123b-4327-ac35-dd419748e0c4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:56.597870 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0064e4d-123b-4327-ac35-dd419748e0c4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:56.734809 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b0064e4d-123b-4327-ac35-dd419748e0c4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:56.742517 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b0064e4d-123b-4327-ac35-dd419748e0c4 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1452 microversion: 2.1 time: 0.159101 Aug 18 11:15:56.743095 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 510/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:56 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:56.764237 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-36950b7c-86e8-4a6f-b3c5-b05f63de8060 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:56.764850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-36950b7c-86e8-4a6f-b3c5-b05f63de8060 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:15:56.771764 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36950b7c-86e8-4a6f-b3c5-b05f63de8060 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:56.772259 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36950b7c-86e8-4a6f-b3c5-b05f63de8060 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:56.772696 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36950b7c-86e8-4a6f-b3c5-b05f63de8060 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:56.773397 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36950b7c-86e8-4a6f-b3c5-b05f63de8060 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:56.773882 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36950b7c-86e8-4a6f-b3c5-b05f63de8060 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:56.774306 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-36950b7c-86e8-4a6f-b3c5-b05f63de8060 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:56.915201 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-36950b7c-86e8-4a6f-b3c5-b05f63de8060 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:15:56.924158 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-36950b7c-86e8-4a6f-b3c5-b05f63de8060 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1452 microversion: 2.1 time: 0.164635 Aug 18 11:15:56.924719 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 527/1037] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:15:56 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:58.813921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-dee18e59-67d0-4071-8a81-8d1ed8bdeff9 req-b48d9523-4b72-4a75-b4fa-3f5e84db32dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e8224ec-e7e9-4e6b-b9d9-461d4b93f819", "tag": "04ed41d0-a64f-4f15-945c-b30d46f02565"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:58.824583 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-dee18e59-67d0-4071-8a81-8d1ed8bdeff9 req-b48d9523-4b72-4a75-b4fa-3f5e84db32dc service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:15:58.827352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-dee18e59-67d0-4071-8a81-8d1ed8bdeff9 req-b48d9523-4b72-4a75-b4fa-3f5e84db32dc service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:15:58.827352 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-dee18e59-67d0-4071-8a81-8d1ed8bdeff9 req-b48d9523-4b72-4a75-b4fa-3f5e84db32dc service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:15:58.836701 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-dee18e59-67d0-4071-8a81-8d1ed8bdeff9 req-b48d9523-4b72-4a75-b4fa-3f5e84db32dc service nova] Creating event network-changed:04ed41d0-a64f-4f15-945c-b30d46f02565 for instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 on hv-cinder-82660 Aug 18 11:15:58.842466 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-dee18e59-67d0-4071-8a81-8d1ed8bdeff9 req-b48d9523-4b72-4a75-b4fa-3f5e84db32dc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032562 Aug 18 11:15:58.843054 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 511/1038] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:17:32.974028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:17:32.974785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=26 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:17:32.978775 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1050457388", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1576310350", "security_groups": [{"name": "tempest-secgroup-smoke-30560218"}], "block_device_mapping_v2": [{"uuid": "de3a6ea9-fec3-48df-8d43-9b3b83b3bf76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b05b383-4bc5-4d6f-8868-dc946d4228f7"}]}} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:17:33.095531 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.network.neutron [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] validate_networks() for [('2b05b383-4bc5-4d6f-8868-dc946d4228f7', None, None, None, None, None)] {{(pid=120800) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:17:33.480715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Flavor limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:17:33.481133 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Image limits 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:17:33.481635 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Flavor pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:17:33.482102 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Image pref 0:0:0 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:17:33.483184 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.virt.hardware [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:17:33.492553 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:33.493031 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:33.493464 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:33.494245 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:33.494826 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:33.495252 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:33.513026 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Getting quotas for project 4cd8f29717d84b5ebfa176b0040f5778. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:17:33.517150 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.quota [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Getting quotas for user d4e3a8a1512c47a19cd3c23f171e24c6 and project 4cd8f29717d84b5ebfa176b0040f5778. Resources: {'cores', 'ram', 'instances'} {{(pid=120800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:17:33.574864 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Going to run 1 instances... {{(pid=120800) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:17:33.576984 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de3a6ea9-fec3-48df-8d43-9b3b83b3bf76',volume_size=None,volume_type=None)] {{(pid=120800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:17:33.707104 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-915395da-5728-4b3c-a5e0-53b78ddc4f28 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.734792 Aug 18 11:17:33.708055 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 528/1039] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Aug 18 11:17:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:17:33.717431 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2c5b284-0722-4238-8559-fdd0bd2aa256] AMQP server on 10.222.0.15:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 18 11:17:33.718456 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:17:33.719615 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:17:33.724492 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4e1ea8e1-4d9d-4a39-851c-2afd40612c8a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:33.725196 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4e1ea8e1-4d9d-4a39-851c-2afd40612c8a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:33.785996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4e1ea8e1-4d9d-4a39-851c-2afd40612c8a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:33.792573 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4e1ea8e1-4d9d-4a39-851c-2afd40612c8a tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1095 microversion: 2.1 time: 0.077328 Aug 18 11:17:33.793162 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 512/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:33 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:34.815814 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-de23d648-afb8-4927-8522-9aec71512155 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:34.816404 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-de23d648-afb8-4927-8522-9aec71512155 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:34.822019 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de23d648-afb8-4927-8522-9aec71512155 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:34.822623 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de23d648-afb8-4927-8522-9aec71512155 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:34.823067 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de23d648-afb8-4927-8522-9aec71512155 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:34.823837 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de23d648-afb8-4927-8522-9aec71512155 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:34.824293 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de23d648-afb8-4927-8522-9aec71512155 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:34.824721 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-de23d648-afb8-4927-8522-9aec71512155 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:34.904179 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-de23d648-afb8-4927-8522-9aec71512155 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:34.912742 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-de23d648-afb8-4927-8522-9aec71512155 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1211 microversion: 2.1 time: 0.102572 Aug 18 11:17:34.913356 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 529/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:34 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:35.935825 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-e58560f3-bc2d-4bd4-8de9-8f3efa133443 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:35.936419 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-e58560f3-bc2d-4bd4-8de9-8f3efa133443 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:35.948774 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2c5b284-0722-4238-8559-fdd0bd2aa256] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 53190. Aug 18 11:17:35.956730 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e58560f3-bc2d-4bd4-8de9-8f3efa133443 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:35.957224 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e58560f3-bc2d-4bd4-8de9-8f3efa133443 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:35.957695 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e58560f3-bc2d-4bd4-8de9-8f3efa133443 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:35.958400 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e58560f3-bc2d-4bd4-8de9-8f3efa133443 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:35.958857 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e58560f3-bc2d-4bd4-8de9-8f3efa133443 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:35.959287 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-e58560f3-bc2d-4bd4-8de9-8f3efa133443 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:35.990344 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-6af5fb5d-5efb-4663-ae50-a01c52b049be req-6a1b05ff-3c35-478f-8bfa-24e053516696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530db127-c3de-4e4c-9aa9-c17869ba5a01", "tag": "965f1393-0d4a-449b-a192-5f3bf1db656b"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:17:36.001896 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6af5fb5d-5efb-4663-ae50-a01c52b049be req-6a1b05ff-3c35-478f-8bfa-24e053516696 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:36.002297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6af5fb5d-5efb-4663-ae50-a01c52b049be req-6a1b05ff-3c35-478f-8bfa-24e053516696 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:36.002759 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-6af5fb5d-5efb-4663-ae50-a01c52b049be req-6a1b05ff-3c35-478f-8bfa-24e053516696 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:36.014734 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-6af5fb5d-5efb-4663-ae50-a01c52b049be req-6a1b05ff-3c35-478f-8bfa-24e053516696 service nova] Creating event network-changed:965f1393-0d4a-449b-a192-5f3bf1db656b for instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 on hv-cinder-82660 Aug 18 11:17:36.020806 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-6af5fb5d-5efb-4663-ae50-a01c52b049be req-6a1b05ff-3c35-478f-8bfa-24e053516696 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034567 Aug 18 11:17:36.021026 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 530/1042] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:17:36.231554 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-e58560f3-bc2d-4bd4-8de9-8f3efa133443 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:36.239764 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-e58560f3-bc2d-4bd4-8de9-8f3efa133443 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.307711 Aug 18 11:17:36.240329 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 513/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:35 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:37.261345 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-6c33d771-23aa-4806-bb2d-b15745f4ec9c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:37.262168 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-6c33d771-23aa-4806-bb2d-b15745f4ec9c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:37.269318 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6c33d771-23aa-4806-bb2d-b15745f4ec9c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:37.269836 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6c33d771-23aa-4806-bb2d-b15745f4ec9c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:37.270273 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6c33d771-23aa-4806-bb2d-b15745f4ec9c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:37.270961 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6c33d771-23aa-4806-bb2d-b15745f4ec9c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:37.271413 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6c33d771-23aa-4806-bb2d-b15745f4ec9c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:37.271840 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-6c33d771-23aa-4806-bb2d-b15745f4ec9c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:37.404458 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-6c33d771-23aa-4806-bb2d-b15745f4ec9c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:37.413193 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-6c33d771-23aa-4806-bb2d-b15745f4ec9c tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.156435 Aug 18 11:17:37.413796 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 531/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:37 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:38.436029 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-5725060a-6942-4de1-bab2-cc1dc1a55f7e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:38.436642 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-5725060a-6942-4de1-bab2-cc1dc1a55f7e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:38.443113 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5725060a-6942-4de1-bab2-cc1dc1a55f7e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:38.443596 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5725060a-6942-4de1-bab2-cc1dc1a55f7e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:38.444033 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5725060a-6942-4de1-bab2-cc1dc1a55f7e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:38.444721 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5725060a-6942-4de1-bab2-cc1dc1a55f7e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:38.445177 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5725060a-6942-4de1-bab2-cc1dc1a55f7e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:38.445629 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-5725060a-6942-4de1-bab2-cc1dc1a55f7e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:38.584040 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-5725060a-6942-4de1-bab2-cc1dc1a55f7e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:38.591698 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-5725060a-6942-4de1-bab2-cc1dc1a55f7e tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.159548 Aug 18 11:17:38.592255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 514/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:38 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:39.612838 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-9ac0a290-736b-48d3-96cd-7324ba146ddf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:39.614208 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-9ac0a290-736b-48d3-96cd-7324ba146ddf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:39.620466 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ac0a290-736b-48d3-96cd-7324ba146ddf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:39.621044 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ac0a290-736b-48d3-96cd-7324ba146ddf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:39.621565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ac0a290-736b-48d3-96cd-7324ba146ddf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:39.622344 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ac0a290-736b-48d3-96cd-7324ba146ddf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:39.622885 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ac0a290-736b-48d3-96cd-7324ba146ddf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:39.623377 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-9ac0a290-736b-48d3-96cd-7324ba146ddf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:39.766785 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-9ac0a290-736b-48d3-96cd-7324ba146ddf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:39.774449 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-9ac0a290-736b-48d3-96cd-7324ba146ddf tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.165954 Aug 18 11:17:39.775015 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 532/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:39 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:40.795481 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-4d851ab4-9129-4f94-9365-28dbadd90188 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:40.796227 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-4d851ab4-9129-4f94-9365-28dbadd90188 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:40.803350 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4d851ab4-9129-4f94-9365-28dbadd90188 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:40.803837 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4d851ab4-9129-4f94-9365-28dbadd90188 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:40.804308 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4d851ab4-9129-4f94-9365-28dbadd90188 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:40.805005 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4d851ab4-9129-4f94-9365-28dbadd90188 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:40.805465 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4d851ab4-9129-4f94-9365-28dbadd90188 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:40.805920 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-4d851ab4-9129-4f94-9365-28dbadd90188 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:40.935384 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-4d851ab4-9129-4f94-9365-28dbadd90188 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:40.943699 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-4d851ab4-9129-4f94-9365-28dbadd90188 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.152298 Aug 18 11:17:40.944304 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 515/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:40 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:41.964673 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e096d9e6-6f1d-4d06-b208-5b162df0d7d7 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:41.965213 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e096d9e6-6f1d-4d06-b208-5b162df0d7d7 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:41.971906 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e096d9e6-6f1d-4d06-b208-5b162df0d7d7 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:41.972390 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e096d9e6-6f1d-4d06-b208-5b162df0d7d7 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:41.972826 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e096d9e6-6f1d-4d06-b208-5b162df0d7d7 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:41.973537 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e096d9e6-6f1d-4d06-b208-5b162df0d7d7 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:41.973998 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e096d9e6-6f1d-4d06-b208-5b162df0d7d7 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:41.974419 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e096d9e6-6f1d-4d06-b208-5b162df0d7d7 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:42.106476 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-e096d9e6-6f1d-4d06-b208-5b162df0d7d7 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:42.114437 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e096d9e6-6f1d-4d06-b208-5b162df0d7d7 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.153721 Aug 18 11:17:42.114996 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 533/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:41 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:43.135421 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-cdee7118-c0db-4438-a4c7-43fb6d47bc07 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:43.136033 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-cdee7118-c0db-4438-a4c7-43fb6d47bc07 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:43.143137 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cdee7118-c0db-4438-a4c7-43fb6d47bc07 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:43.143720 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cdee7118-c0db-4438-a4c7-43fb6d47bc07 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:43.144158 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cdee7118-c0db-4438-a4c7-43fb6d47bc07 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:43.144845 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cdee7118-c0db-4438-a4c7-43fb6d47bc07 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:43.145296 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cdee7118-c0db-4438-a4c7-43fb6d47bc07 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:43.145750 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-cdee7118-c0db-4438-a4c7-43fb6d47bc07 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:43.282360 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-cdee7118-c0db-4438-a4c7-43fb6d47bc07 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:43.290079 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-cdee7118-c0db-4438-a4c7-43fb6d47bc07 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.158473 Aug 18 11:17:43.290655 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 516/1049] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:43 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:44.311232 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-d5646583-f99c-4cce-96cd-4e31d5585cd9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:44.311780 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-d5646583-f99c-4cce-96cd-4e31d5585cd9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:44.315138 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=2 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:17:44.315838 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell0:SELECT=6 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:17:44.321793 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d5646583-f99c-4cce-96cd-4e31d5585cd9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:44.322284 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d5646583-f99c-4cce-96cd-4e31d5585cd9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:44.322727 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d5646583-f99c-4cce-96cd-4e31d5585cd9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:44.323430 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d5646583-f99c-4cce-96cd-4e31d5585cd9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:44.323885 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d5646583-f99c-4cce-96cd-4e31d5585cd9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:44.324313 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-d5646583-f99c-4cce-96cd-4e31d5585cd9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:44.455708 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-d5646583-f99c-4cce-96cd-4e31d5585cd9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:44.463171 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-d5646583-f99c-4cce-96cd-4e31d5585cd9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.155882 Aug 18 11:17:44.463733 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 534/1050] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:44 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:45.483340 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b070a1e8-009b-4c95-9b30-f5d5e638bd9b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:45.483931 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b070a1e8-009b-4c95-9b30-f5d5e638bd9b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:45.487864 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell0:SELECT=2 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:17:45.492420 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b070a1e8-009b-4c95-9b30-f5d5e638bd9b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:45.492920 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b070a1e8-009b-4c95-9b30-f5d5e638bd9b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:45.493358 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b070a1e8-009b-4c95-9b30-f5d5e638bd9b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:45.494077 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b070a1e8-009b-4c95-9b30-f5d5e638bd9b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:45.494523 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b070a1e8-009b-4c95-9b30-f5d5e638bd9b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:45.494950 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b070a1e8-009b-4c95-9b30-f5d5e638bd9b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:45.628782 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b070a1e8-009b-4c95-9b30-f5d5e638bd9b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:45.636719 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b070a1e8-009b-4c95-9b30-f5d5e638bd9b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.157115 Aug 18 11:17:45.642508 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 517/1051] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:45 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:46.658633 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-68558d03-1e88-428a-bbed-13a19296be9f tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:46.663369 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-68558d03-1e88-428a-bbed-13a19296be9f tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:46.665924 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68558d03-1e88-428a-bbed-13a19296be9f tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:46.666423 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68558d03-1e88-428a-bbed-13a19296be9f tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:46.666855 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68558d03-1e88-428a-bbed-13a19296be9f tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:46.667554 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68558d03-1e88-428a-bbed-13a19296be9f tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:46.668012 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68558d03-1e88-428a-bbed-13a19296be9f tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:46.668591 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-68558d03-1e88-428a-bbed-13a19296be9f tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:46.801059 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-68558d03-1e88-428a-bbed-13a19296be9f tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:46.808439 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-68558d03-1e88-428a-bbed-13a19296be9f tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.153751 Aug 18 11:17:46.808989 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 535/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:46 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:47.170074 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-5c991b40-e4ea-4ac3-97c4-ddd896f42670 req-9391d20d-8e22-4e31-a39a-b5e8ce149da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530db127-c3de-4e4c-9aa9-c17869ba5a01", "name": "network-vif-plugged", "status": "completed", "tag": "965f1393-0d4a-449b-a192-5f3bf1db656b"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:17:47.180380 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-5c991b40-e4ea-4ac3-97c4-ddd896f42670 req-9391d20d-8e22-4e31-a39a-b5e8ce149da5 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:47.180829 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-5c991b40-e4ea-4ac3-97c4-ddd896f42670 req-9391d20d-8e22-4e31-a39a-b5e8ce149da5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:47.181598 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-5c991b40-e4ea-4ac3-97c4-ddd896f42670 req-9391d20d-8e22-4e31-a39a-b5e8ce149da5 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:47.194363 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-5c991b40-e4ea-4ac3-97c4-ddd896f42670 req-9391d20d-8e22-4e31-a39a-b5e8ce149da5 service nova] Creating event network-vif-plugged:965f1393-0d4a-449b-a192-5f3bf1db656b for instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 on hv-cinder-82660 Aug 18 11:17:47.200168 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-5c991b40-e4ea-4ac3-97c4-ddd896f42670 req-9391d20d-8e22-4e31-a39a-b5e8ce149da5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033670 Aug 18 11:17:47.200996 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 518/1053] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:17:47.828863 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-ea8d6d68-c9f8-4d7d-a3fe-4e30bd675bd8 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:47.830106 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-ea8d6d68-c9f8-4d7d-a3fe-4e30bd675bd8 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:47.836495 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ea8d6d68-c9f8-4d7d-a3fe-4e30bd675bd8 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:47.836974 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ea8d6d68-c9f8-4d7d-a3fe-4e30bd675bd8 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:47.837405 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ea8d6d68-c9f8-4d7d-a3fe-4e30bd675bd8 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:47.838109 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ea8d6d68-c9f8-4d7d-a3fe-4e30bd675bd8 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:47.838560 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ea8d6d68-c9f8-4d7d-a3fe-4e30bd675bd8 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:47.838978 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-ea8d6d68-c9f8-4d7d-a3fe-4e30bd675bd8 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:47.972084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-ea8d6d68-c9f8-4d7d-a3fe-4e30bd675bd8 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:47.979575 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-ea8d6d68-c9f8-4d7d-a3fe-4e30bd675bd8 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1265 microversion: 2.1 time: 0.154537 Aug 18 11:17:47.980137 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 536/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:47 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:49.001571 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-a17bef49-d8cc-4fb1-929a-f0f19f7ca660 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:49.002398 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-a17bef49-d8cc-4fb1-929a-f0f19f7ca660 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:49.008881 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a17bef49-d8cc-4fb1-929a-f0f19f7ca660 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:49.009389 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a17bef49-d8cc-4fb1-929a-f0f19f7ca660 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:49.009828 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a17bef49-d8cc-4fb1-929a-f0f19f7ca660 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:49.010515 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a17bef49-d8cc-4fb1-929a-f0f19f7ca660 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:49.010966 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a17bef49-d8cc-4fb1-929a-f0f19f7ca660 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:49.011385 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-a17bef49-d8cc-4fb1-929a-f0f19f7ca660 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:49.150481 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-a17bef49-d8cc-4fb1-929a-f0f19f7ca660 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:49.158289 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-a17bef49-d8cc-4fb1-929a-f0f19f7ca660 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1453 microversion: 2.1 time: 0.161544 Aug 18 11:17:49.158862 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 519/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:48 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:49.178165 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-a4ac54a3-1488-497c-94d3-efe50c03cc97 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:49.178784 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-a4ac54a3-1488-497c-94d3-efe50c03cc97 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:17:49.185309 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a4ac54a3-1488-497c-94d3-efe50c03cc97 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:49.185834 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a4ac54a3-1488-497c-94d3-efe50c03cc97 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:49.186287 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a4ac54a3-1488-497c-94d3-efe50c03cc97 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:49.186980 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a4ac54a3-1488-497c-94d3-efe50c03cc97 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:49.187445 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a4ac54a3-1488-497c-94d3-efe50c03cc97 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:49.188072 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-a4ac54a3-1488-497c-94d3-efe50c03cc97 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:49.320084 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-a4ac54a3-1488-497c-94d3-efe50c03cc97 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:17:49.327786 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-a4ac54a3-1488-497c-94d3-efe50c03cc97 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1453 microversion: 2.1 time: 0.153410 Aug 18 11:17:49.328349 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 537/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:17:49 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:51.179506 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-28187954-cedb-4068-b14a-346e6fd6679a req-fbd89a3d-bc5a-49c3-81fc-1c4e71bbfda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530db127-c3de-4e4c-9aa9-c17869ba5a01", "tag": "965f1393-0d4a-449b-a192-5f3bf1db656b"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:17:51.190667 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-28187954-cedb-4068-b14a-346e6fd6679a req-fbd89a3d-bc5a-49c3-81fc-1c4e71bbfda7 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:17:51.191155 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-28187954-cedb-4068-b14a-346e6fd6679a req-fbd89a3d-bc5a-49c3-81fc-1c4e71bbfda7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:17:51.191592 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-28187954-cedb-4068-b14a-346e6fd6679a req-fbd89a3d-bc5a-49c3-81fc-1c4e71bbfda7 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:17:51.202921 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-28187954-cedb-4068-b14a-346e6fd6679a req-fbd89a3d-bc5a-49c3-81fc-1c4e71bbfda7 service nova] Creating event network-changed:965f1393-0d4a-449b-a192-5f3bf1db656b for instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 on hv-cinder-82660 Aug 18 11:17:51.210252 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-28187954-cedb-4068-b14a-346e6fd6679a req-fbd89a3d-bc5a-49c3-81fc-1c4e71bbfda7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034424 Aug 18 11:17:51.210856 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 520/1057] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:17:55.489166 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:17:55.489961 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Thu Aug 18 11:17:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:17:56.269123 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:17:56.269340 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Thu Aug 18 11:17:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:18:06.163186 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:18:06.163821 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Thu Aug 18 11:18:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:19:19.419803 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_api:SELECT=20 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:19:19.420549 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG dbcounter [-] [120801] Writing DB stats nova_cell1:SELECT=40 {{(pid=120801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:19:19.421180 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-df600332-a970-4d6b-ba37-ebcec239bb02 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:19.421807 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-df600332-a970-4d6b-ba37-ebcec239bb02 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:19.424358 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:19:19.425694 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG dbcounter [-] [120800] Writing DB stats nova_cell1:SELECT=52 {{(pid=120800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:19:19.433254 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df600332-a970-4d6b-ba37-ebcec239bb02 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:19.433937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df600332-a970-4d6b-ba37-ebcec239bb02 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:19.434379 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df600332-a970-4d6b-ba37-ebcec239bb02 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:19.435249 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df600332-a970-4d6b-ba37-ebcec239bb02 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:19.435709 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df600332-a970-4d6b-ba37-ebcec239bb02 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:19.436135 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-df600332-a970-4d6b-ba37-ebcec239bb02 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:19.465297 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-df600332-a970-4d6b-ba37-ebcec239bb02 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Going to try to terminate instance {{(pid=120800) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:19:19.546266 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-df600332-a970-4d6b-ba37-ebcec239bb02 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "DELETE /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 204 len: 0 microversion: 2.1 time: 0.130716 Aug 18 11:19:19.547203 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 538/1058] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:19:19 2022] DELETE /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:19:19.565472 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-af1675a8-9f80-4bcd-a4be-88496fbf40cc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:19.565745 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [req-c7578cce-34f2-4883-8217-a8d843019af5 req-e1d56d5e-4bc5-445d-abb1-3d56111ce186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "530db127-c3de-4e4c-9aa9-c17869ba5a01", "tag": "965f1393-0d4a-449b-a192-5f3bf1db656b"}]} {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:19:19.566394 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-af1675a8-9f80-4bcd-a4be-88496fbf40cc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:19.573198 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af1675a8-9f80-4bcd-a4be-88496fbf40cc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:19.573808 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af1675a8-9f80-4bcd-a4be-88496fbf40cc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:19.574242 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af1675a8-9f80-4bcd-a4be-88496fbf40cc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:19.574959 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af1675a8-9f80-4bcd-a4be-88496fbf40cc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:19.575438 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af1675a8-9f80-4bcd-a4be-88496fbf40cc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:19.575835 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-af1675a8-9f80-4bcd-a4be-88496fbf40cc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:19.576862 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-c7578cce-34f2-4883-8217-a8d843019af5 req-e1d56d5e-4bc5-445d-abb1-3d56111ce186 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:19.577339 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-c7578cce-34f2-4883-8217-a8d843019af5 req-e1d56d5e-4bc5-445d-abb1-3d56111ce186 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:19.577803 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [req-c7578cce-34f2-4883-8217-a8d843019af5 req-e1d56d5e-4bc5-445d-abb1-3d56111ce186 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:19.588476 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.compute.server_external_events [req-c7578cce-34f2-4883-8217-a8d843019af5 req-e1d56d5e-4bc5-445d-abb1-3d56111ce186 service nova] Creating event network-changed:965f1393-0d4a-449b-a192-5f3bf1db656b for instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 on hv-cinder-82660 Aug 18 11:19:19.593877 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [req-c7578cce-34f2-4883-8217-a8d843019af5 req-e1d56d5e-4bc5-445d-abb1-3d56111ce186 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176098 Aug 18 11:19:19.594477 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 521/1059] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:19:19.781937 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-af1675a8-9f80-4bcd-a4be-88496fbf40cc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:19:19.790926 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-af1675a8-9f80-4bcd-a4be-88496fbf40cc tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1578 microversion: 2.1 time: 0.230425 Aug 18 11:19:19.791507 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 539/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:19:19 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1578 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:19:20.814914 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-efe622e8-1891-4df2-9b70-e530d469d134 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:20.816255 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-efe622e8-1891-4df2-9b70-e530d469d134 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:20.822517 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efe622e8-1891-4df2-9b70-e530d469d134 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:20.823004 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efe622e8-1891-4df2-9b70-e530d469d134 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:20.823445 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efe622e8-1891-4df2-9b70-e530d469d134 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:20.824145 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efe622e8-1891-4df2-9b70-e530d469d134 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:20.824605 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efe622e8-1891-4df2-9b70-e530d469d134 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:20.825032 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-efe622e8-1891-4df2-9b70-e530d469d134 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:21.048294 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-efe622e8-1891-4df2-9b70-e530d469d134 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:19:21.057173 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-efe622e8-1891-4df2-9b70-e530d469d134 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1578 microversion: 2.1 time: 0.247047 Aug 18 11:19:21.057785 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 522/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:19:20 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1578 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:19:21.897412 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-c83a9c20-4dd1-4b38-ba5a-4c0b7b06f8ca req-f2ca2f3b-043e-4cd4-822d-601cf5028ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "530db127-c3de-4e4c-9aa9-c17869ba5a01", "name": "network-vif-deleted", "tag": "965f1393-0d4a-449b-a192-5f3bf1db656b"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:19:21.907383 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-c83a9c20-4dd1-4b38-ba5a-4c0b7b06f8ca req-f2ca2f3b-043e-4cd4-822d-601cf5028ae6 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:21.907879 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-c83a9c20-4dd1-4b38-ba5a-4c0b7b06f8ca req-f2ca2f3b-043e-4cd4-822d-601cf5028ae6 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:21.908309 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-c83a9c20-4dd1-4b38-ba5a-4c0b7b06f8ca req-f2ca2f3b-043e-4cd4-822d-601cf5028ae6 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:21.919352 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-c83a9c20-4dd1-4b38-ba5a-4c0b7b06f8ca req-f2ca2f3b-043e-4cd4-822d-601cf5028ae6 service nova] Creating event network-vif-deleted:965f1393-0d4a-449b-a192-5f3bf1db656b for instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 on hv-cinder-82660 Aug 18 11:19:21.925070 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-c83a9c20-4dd1-4b38-ba5a-4c0b7b06f8ca req-f2ca2f3b-043e-4cd4-822d-601cf5028ae6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099412 Aug 18 11:19:21.925563 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 540/1062] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:19:22.079071 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-50ced99d-c779-49b5-8215-91f350e66ff9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:22.079718 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-50ced99d-c779-49b5-8215-91f350e66ff9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:22.087434 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-50ced99d-c779-49b5-8215-91f350e66ff9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:22.088260 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-50ced99d-c779-49b5-8215-91f350e66ff9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:22.089088 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-50ced99d-c779-49b5-8215-91f350e66ff9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:22.090357 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-50ced99d-c779-49b5-8215-91f350e66ff9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:22.090824 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-50ced99d-c779-49b5-8215-91f350e66ff9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:22.091305 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-50ced99d-c779-49b5-8215-91f350e66ff9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:22.156032 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-50ced99d-c779-49b5-8215-91f350e66ff9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:19:22.164229 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-50ced99d-c779-49b5-8215-91f350e66ff9 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 200 len: 1226 microversion: 2.1 time: 0.088883 Aug 18 11:19:22.165496 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 523/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:19:22 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:19:23.185604 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:23.186308 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 530db127-c3de-4e4c-9aa9-c17869ba5a01] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:23.194361 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:23.194858 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:23.195353 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:23.196000 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:23.196455 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:23.196914 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:23.216207 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] HTTP exception thrown: Instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 could not be found. Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Request method failure captured: Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 HTTP/1.1 Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_h6wNzQLKfmw3iV8DW5NnS5yuE_2x3hmGFu29cGoQHy-UcjwRzbd2mtWd4FzfE4bTcfWRtQFhtgckmOuS41WRmEIemN3_-5eOY4cB457Je91YB5HZ3Wnhb-UmqEeCvSRNwt0zi7OIRMWzT98Rzebimh-_UacsMhqqegOctlo3ASgD1E Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 4cd8f29717d84b5ebfa176b0040f5778 Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:19:23.217908 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4cd8f29717d84b5ebfa176b0040f5778", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4cd8f29717d84b5ebfa176b0040f5778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4cd8f29717d84b5ebfa176b0040f5778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4cd8f29717d84b5ebfa176b0040f5778"}]}] Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 4cd8f29717d84b5ebfa176b0040f5778 Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-TestVolumeBootPattern-822241465-project Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: d4e3a8a1512c47a19cd3c23f171e24c6 Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-TestVolumeBootPattern-822241465-project Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 could not be found. Aug 18 11:19:23.219693 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '530db127-c3de-4e4c-9aa9-c17869ba5a01'} Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 could not be found. Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:19:23.221298 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 could not be found. Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 could not be found. Aug 18 11:19:23.222850 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:23.224121 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Returning 404 to user: Instance 530db127-c3de-4e4c-9aa9-c17869ba5a01 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:19:23.224121 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-285e6f0d-862d-402d-a24c-889421e82933 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01" status: 404 len: 111 microversion: 2.1 time: 0.038997 Aug 18 11:19:23.224121 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 541/1064] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:19:23 2022] GET /compute/v2.1/servers/530db127-c3de-4e4c-9aa9-c17869ba5a01 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:19:26.558177 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-ebfc5876-1277-4681-8bd5-0042e1285165 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:26.558998 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ebfc5876-1277-4681-8bd5-0042e1285165 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:26.560704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-931657d6-8cc0-4c58-b1e1-b432a1b834ba req-5ecf77f9-3a8c-4d86-a62b-d2b521b40885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e8224ec-e7e9-4e6b-b9d9-461d4b93f819", "tag": "04ed41d0-a64f-4f15-945c-b30d46f02565"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:19:26.566547 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ebfc5876-1277-4681-8bd5-0042e1285165 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:26.567336 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ebfc5876-1277-4681-8bd5-0042e1285165 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:26.567532 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ebfc5876-1277-4681-8bd5-0042e1285165 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:26.568379 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ebfc5876-1277-4681-8bd5-0042e1285165 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:26.568957 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ebfc5876-1277-4681-8bd5-0042e1285165 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:26.569453 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-ebfc5876-1277-4681-8bd5-0042e1285165 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:26.571338 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-931657d6-8cc0-4c58-b1e1-b432a1b834ba req-5ecf77f9-3a8c-4d86-a62b-d2b521b40885 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:26.572151 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-931657d6-8cc0-4c58-b1e1-b432a1b834ba req-5ecf77f9-3a8c-4d86-a62b-d2b521b40885 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:26.573150 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-931657d6-8cc0-4c58-b1e1-b432a1b834ba req-5ecf77f9-3a8c-4d86-a62b-d2b521b40885 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:26.585631 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-931657d6-8cc0-4c58-b1e1-b432a1b834ba req-5ecf77f9-3a8c-4d86-a62b-d2b521b40885 service nova] Creating event network-changed:04ed41d0-a64f-4f15-945c-b30d46f02565 for instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 on hv-cinder-82660 Aug 18 11:19:26.591392 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-931657d6-8cc0-4c58-b1e1-b432a1b834ba req-5ecf77f9-3a8c-4d86-a62b-d2b521b40885 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034460 Aug 18 11:19:26.593851 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 542/1065] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:19:26.595501 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-ebfc5876-1277-4681-8bd5-0042e1285165 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Going to try to terminate instance {{(pid=120801) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:19:26.683281 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-ebfc5876-1277-4681-8bd5-0042e1285165 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 204 len: 0 microversion: 2.1 time: 0.128747 Aug 18 11:19:26.687614 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 524/1066] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:19:26 2022] DELETE /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:19:26.694858 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-50aaf41a-afae-431a-ba58-7c634c84bd88 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:26.695979 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-50aaf41a-afae-431a-ba58-7c634c84bd88 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:26.702716 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aaf41a-afae-431a-ba58-7c634c84bd88 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:26.703537 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aaf41a-afae-431a-ba58-7c634c84bd88 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:26.704226 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aaf41a-afae-431a-ba58-7c634c84bd88 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:26.705012 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aaf41a-afae-431a-ba58-7c634c84bd88 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:26.705837 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aaf41a-afae-431a-ba58-7c634c84bd88 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:26.707789 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-50aaf41a-afae-431a-ba58-7c634c84bd88 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:26.853577 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.policy [None req-50aaf41a-afae-431a-ba58-7c634c84bd88 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120800) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:19:26.861384 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-50aaf41a-afae-431a-ba58-7c634c84bd88 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1576 microversion: 2.1 time: 0.172211 Aug 18 11:19:26.862565 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 543/1067] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:19:26 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:19:27.884518 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-0739a662-7de9-404e-90f2-3f2a8aa577c2 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:27.885220 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-0739a662-7de9-404e-90f2-3f2a8aa577c2 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:27.891409 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0739a662-7de9-404e-90f2-3f2a8aa577c2 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:27.891897 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0739a662-7de9-404e-90f2-3f2a8aa577c2 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:27.892330 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0739a662-7de9-404e-90f2-3f2a8aa577c2 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:27.893596 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0739a662-7de9-404e-90f2-3f2a8aa577c2 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:27.894858 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0739a662-7de9-404e-90f2-3f2a8aa577c2 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:27.895292 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-0739a662-7de9-404e-90f2-3f2a8aa577c2 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:28.065056 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-0739a662-7de9-404e-90f2-3f2a8aa577c2 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:19:28.072796 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-0739a662-7de9-404e-90f2-3f2a8aa577c2 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1576 microversion: 2.1 time: 0.192480 Aug 18 11:19:28.073360 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 525/1068] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:19:27 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:19:28.749100 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [req-27dff925-58fe-4152-b435-984e5aaeaa3e req-47ebc657-12ed-43fb-9954-3c044a3760e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8224ec-e7e9-4e6b-b9d9-461d4b93f819", "name": "network-vif-deleted", "tag": "04ed41d0-a64f-4f15-945c-b30d46f02565"}]} {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:19:28.761153 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-27dff925-58fe-4152-b435-984e5aaeaa3e req-47ebc657-12ed-43fb-9954-3c044a3760e3 service nova] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:28.761668 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-27dff925-58fe-4152-b435-984e5aaeaa3e req-47ebc657-12ed-43fb-9954-3c044a3760e3 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:28.762103 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [req-27dff925-58fe-4152-b435-984e5aaeaa3e req-47ebc657-12ed-43fb-9954-3c044a3760e3 service nova] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:28.774691 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.compute.server_external_events [req-27dff925-58fe-4152-b435-984e5aaeaa3e req-47ebc657-12ed-43fb-9954-3c044a3760e3 service nova] Creating event network-vif-deleted:04ed41d0-a64f-4f15-945c-b30d46f02565 for instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 on hv-cinder-82660 Aug 18 11:19:28.779423 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [req-27dff925-58fe-4152-b435-984e5aaeaa3e req-47ebc657-12ed-43fb-9954-3c044a3760e3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034611 Aug 18 11:19:28.780020 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 544/1069] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Aug 18 11:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:19:29.093811 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:29.094426 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:29.102417 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:29.102913 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:29.103350 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:29.104061 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:29.104519 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:29.104946 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:29.142259 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:29.142754 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:29.143289 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:29.144459 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.objects.instance [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lazy-loading 'fault' on Instance uuid 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 {{(pid=120801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:19:29.193360 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.policy [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e3a8a1512c47a19cd3c23f171e24c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8f29717d84b5ebfa176b0040f5778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120801) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:19:29.201678 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-b0523eca-844a-400a-b5f9-794a3aabb9e1 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 200 len: 1231 microversion: 2.1 time: 0.111755 Aug 18 11:19:29.202250 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 526/1070] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:19:29 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 1231 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:19:30.224299 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:30.225010 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:30.231335 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:30.231827 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:30.232268 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:30.232973 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:30.233435 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:30.233889 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:30.247450 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] HTTP exception thrown: Instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 could not be found. Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Request method failure captured: Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 HTTP/1.1 Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_h6wNzQLKfmw3iV8DW5NnS5yuE_2x3hmGFu29cGoQHy-UcjwRzbd2mtWd4FzfE4bTcfWRtQFhtgckmOuS41WRmEIemN3_-5eOY4cB457Je91YB5HZ3Wnhb-UmqEeCvSRNwt0zi7OIRMWzT98Rzebimh-_UacsMhqqegOctlo3ASgD1E Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 4cd8f29717d84b5ebfa176b0040f5778 Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:19:30.249075 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4cd8f29717d84b5ebfa176b0040f5778", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4cd8f29717d84b5ebfa176b0040f5778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4cd8f29717d84b5ebfa176b0040f5778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4cd8f29717d84b5ebfa176b0040f5778"}]}] Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 4cd8f29717d84b5ebfa176b0040f5778 Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-TestVolumeBootPattern-822241465-project Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: d4e3a8a1512c47a19cd3c23f171e24c6 Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-TestVolumeBootPattern-822241465-project Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 could not be found. Aug 18 11:19:30.250758 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '9e8224ec-e7e9-4e6b-b9d9-461d4b93f819'} Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 could not be found. Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:19:30.251704 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 could not be found. Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 could not be found. Aug 18 11:19:30.253869 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.255279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Returning 404 to user: Instance 9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:19:30.255279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-c1496a73-dbc3-40ce-aa16-2906a481994d tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819" status: 404 len: 111 microversion: 2.1 time: 0.031731 Aug 18 11:19:30.255279 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 545/1071] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:19:30 2022] GET /compute/v2.1/servers/9e8224ec-e7e9-4e6b-b9d9-461d4b93f819 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:19:30.698747 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:30.699278 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.compute.api [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120801) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:30.706034 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:30.706511 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:30.706960 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:30.707634 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:30.708103 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:30.708504 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG oslo_concurrency.lockutils [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:30.722429 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.wsgi [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] HTTP exception thrown: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Request method failure captured: Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: request: DELETE /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 HTTP/1.1 Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept: application/json Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Accept-Encoding: identity Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Connection: close Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Length: 0 Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Content-Type: application/json Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Host: 10.222.0.15 Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Openstack-System-Scope: None Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: User-Agent: python-urllib3/1.26.11 Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Auth-Token: gAAAAABi_h6wNzQLKfmw3iV8DW5NnS5yuE_2x3hmGFu29cGoQHy-UcjwRzbd2mtWd4FzfE4bTcfWRtQFhtgckmOuS41WRmEIemN3_-5eOY4cB457Je91YB5HZ3Wnhb-UmqEeCvSRNwt0zi7OIRMWzT98Rzebimh-_UacsMhqqegOctlo3ASgD1E Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Id: None Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Domain-Name: None Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Identity-Status: Confirmed Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Is-Admin-Project: True Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Id: default Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Domain-Name: Default Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Id: 4cd8f29717d84b5ebfa176b0040f5778 Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Project-Name: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Role: member,reader Aug 18 11:19:30.724062 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Roles: member,reader Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4cd8f29717d84b5ebfa176b0040f5778", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4cd8f29717d84b5ebfa176b0040f5778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4cd8f29717d84b5ebfa176b0040f5778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4cd8f29717d84b5ebfa176b0040f5778"}]}] Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Id: 4cd8f29717d84b5ebfa176b0040f5778 Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-Tenant-Name: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User: tempest-TestVolumeBootPattern-822241465-project Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Id: default Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Domain-Name: Default Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Id: d4e3a8a1512c47a19cd3c23f171e24c6 Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: X-User-Name: tempest-TestVolumeBootPattern-822241465-project Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: method: > Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: exception: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:19:30.725952 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: action_args: {'id': '2cb72685-d575-48ff-b600-bd170ababcc6'} Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:19:30.726943 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:19:30.728499 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.730045 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Returning 404 to user: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. {{(pid=120801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:19:30.730045 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-edcbd646-fd8e-40f9-8a02-ebef5a2b6123 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 404 len: 111 microversion: 2.1 time: 0.030568 Aug 18 11:19:30.730045 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 527/1072] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Aug 18 11:19:30 2022] DELETE /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:19:30.733991 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '>' {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:30.734610 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.compute.api [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] [instance: 2cb72685-d575-48ff-b600-bd170ababcc6] Fetching instance by UUID {{(pid=120800) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:19:30.741277 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:30.742028 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:30.742468 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:30.743170 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Acquiring lock "6dc9e351-1b25-4e87-b441-33938908aec2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:19:30.743627 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:19:30.744052 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG oslo_concurrency.lockutils [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Lock "6dc9e351-1b25-4e87-b441-33938908aec2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:19:30.757551 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.wsgi [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] HTTP exception thrown: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Request method failure captured: Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: request: GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 HTTP/1.1 Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept: application/json Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Accept-Encoding: identity Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Connection: close Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Length: 0 Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Content-Type: application/json Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Host: 10.222.0.15 Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Openstack-System-Scope: None Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: User-Agent: python-urllib3/1.26.11 Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Auth-Token: gAAAAABi_h6wNzQLKfmw3iV8DW5NnS5yuE_2x3hmGFu29cGoQHy-UcjwRzbd2mtWd4FzfE4bTcfWRtQFhtgckmOuS41WRmEIemN3_-5eOY4cB457Je91YB5HZ3Wnhb-UmqEeCvSRNwt0zi7OIRMWzT98Rzebimh-_UacsMhqqegOctlo3ASgD1E Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Id: None Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Domain-Name: None Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Identity-Status: Confirmed Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Is-Admin-Project: True Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Id: default Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Domain-Name: Default Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Id: 4cd8f29717d84b5ebfa176b0040f5778 Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Project-Name: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Role: member,reader Aug 18 11:19:30.759064 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Roles: member,reader Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4cd8f29717d84b5ebfa176b0040f5778", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4cd8f29717d84b5ebfa176b0040f5778"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4cd8f29717d84b5ebfa176b0040f5778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4cd8f29717d84b5ebfa176b0040f5778"}]}] Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Id: 4cd8f29717d84b5ebfa176b0040f5778 Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-Tenant-Name: tempest-TestVolumeBootPattern-822241465 Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User: tempest-TestVolumeBootPattern-822241465-project Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Id: default Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Domain-Name: Default Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Id: d4e3a8a1512c47a19cd3c23f171e24c6 Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: X-User-Name: tempest-TestVolumeBootPattern-822241465-project Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: method: > Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: exception: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:19:30.760715 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: action_args: {'id': '2cb72685-d575-48ff-b600-bd170ababcc6'} Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: {{(pid=120800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:19:30.761655 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. Aug 18 11:19:30.763257 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: ERROR nova.api.openstack.wsgi Aug 18 11:19:30.764990 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: DEBUG nova.api.openstack.wsgi [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Returning 404 to user: Instance 2cb72685-d575-48ff-b600-bd170ababcc6 could not be found. {{(pid=120800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:19:30.764990 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO nova.api.openstack.requestlog [None req-e28a1128-5c05-4ff7-887b-62d968cc085b tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6" status: 404 len: 111 microversion: 2.1 time: 0.030247 Aug 18 11:19:30.764990 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: [pid: 120800|app: 0|req: 546/1073] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Aug 18 11:19:30 2022] GET /compute/v2.1/servers/2cb72685-d575-48ff-b600-bd170ababcc6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:19:32.061310 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: DEBUG nova.api.openstack.wsgi [None req-1d366011-8e64-48ce-aebb-145d75f76c38 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] Calling method '.version_select at 0x7f7ec8ba8430>' {{(pid=120801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:19:32.087520 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO nova.api.openstack.requestlog [None req-1d366011-8e64-48ce-aebb-145d75f76c38 tempest-TestVolumeBootPattern-822241465 tempest-TestVolumeBootPattern-822241465-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1576310350" status: 202 len: 0 microversion: 2.1 time: 0.029808 Aug 18 11:19:32.088399 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: [pid: 120801|app: 0|req: 528/1074] 10.222.0.15 () {58 vars in 1263 bytes} [Thu Aug 18 11:19:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1576310350 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:19:36.866637 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:19:36.867208 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Thu Aug 18 11:19:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:21:15.497574 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:21:15.498161 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Thu Aug 18 11:21:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:21:26.171914 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:21:26.172547 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Thu Aug 18 11:21:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:22:56.876389 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:22:56.877191 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Thu Aug 18 11:22:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:24:35.505922 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:24:35.506528 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Thu Aug 18 11:24:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:24:36.281868 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:24:36.282104 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Thu Aug 18 11:24:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:24:46.180204 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:24:46.180843 dv-cinder-826608-10-iscsi devstack@n-api.service[120800]: Thu Aug 18 11:24:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:24:50.954601 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:24:50.955197 dv-cinder-826608-10-iscsi devstack@n-api.service[120801]: Thu Aug 18 11:24:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!